-- Logs begin at Mon 2022-08-08 01:18:33 UTC, end at Mon 2022-08-08 03:07:27 UTC. -- Aug 08 02:23:55.592914 dv-cinder-852261-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 02:23:55.604570 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:23:55 2022] *** Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: nodename: dv-cinder-852261-2-iscsi Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: machine: x86_64 Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: clock source: unix Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: pcre jit disabled Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: detected number of CPU cores: 4 Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: current working directory: / Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:23:55.606539 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: your processes number limit is 47680 Aug 08 02:23:55.607309 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: your memory page size is 4096 bytes Aug 08 02:23:55.607309 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: detected max file descriptor number: 2048 Aug 08 02:23:55.607309 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: lock engine: pthread robust mutexes Aug 08 02:23:55.607309 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: thunder lock: enabled Aug 08 02:23:55.607309 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 02:23:55.607309 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:23:55.645755 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: Python main interpreter initialized at 0x55ceece3e9c0 Aug 08 02:23:55.645755 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: python threads support enabled Aug 08 02:23:55.645755 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: your server socket listen backlog is limited to 100 connections Aug 08 02:23:55.645755 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:23:55.646098 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:23:55.646189 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: *** Operational MODE: preforking *** Aug 08 02:23:55.646444 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:23:55.646444 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: spawned uWSGI master process (pid: 103522) Aug 08 02:23:55.646637 dv-cinder-852261-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 02:23:55.647571 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: spawned uWSGI worker 1 (pid: 103523, cores: 1) Aug 08 02:23:55.647571 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: spawned uWSGI worker 2 (pid: 103524, cores: 1) Aug 08 02:23:55.647717 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:23:56.307746 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:23:56.321086 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:23:57.388733 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:23:57.388733 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Aug 08 02:23:57.389310 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:23:57.389310 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Aug 08 02:23:57.401118 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:23:57.401118 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: from cryptography.utils import int_from_bytes Aug 08 02:23:57.401582 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:23:57.401582 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: from cryptography.utils import int_from_bytes Aug 08 02:23:59.874306 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:23:59.874976 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:23:59.875104 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:23:59.875461 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:23:59.875715 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:23:59.875808 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:23:59.876176 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:23:59.876265 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.876402 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.876538 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:23:59.876720 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.876899 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:23:59.877035 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.877157 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:23:59.877362 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.877541 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.877668 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.877865 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.877983 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.878185 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.878301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.879127 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.879277 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.879464 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.879559 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.879778 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.879874 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.880100 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.880187 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-2-iscsi {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.880421 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.880515 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.880750 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.880837 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881016 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881105 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881333 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881450 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881654 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881746 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-2-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.881973 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.882073 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.882280 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.882409 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.882618 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.882805 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.882919 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.883235 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.883356 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.883541 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.883653 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.883854 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.883949 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.884186 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.884359 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.884500 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.884711 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.884849 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.884946 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.885114 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.885262 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.885423 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.885597 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.885741 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.885910 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.886044 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.886221 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.886461 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-2-iscsi {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.886565 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.886779 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.886877 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.887090 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.887184 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.887402 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.887491 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.887809 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.887942 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-2-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.888117 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.888204 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.888424 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.888529 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.888777 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.888895 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.889062 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.889155 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.889368 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.889465 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.889708 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.889807 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890025 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890112 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890341 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890449 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890679 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890778 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.890980 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.891075 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.891286 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.891376 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.891594 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.891692 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.891910 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892007 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892211 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892298 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892509 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892606 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892760 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.892848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893066 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893160 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893382 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893487 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893700 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893797 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.893950 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.894044 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.894285 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.894423 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.894555 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.894741 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895020 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895118 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895340 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895429 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895612 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895699 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.895865 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896035 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896186 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896274 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896508 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896599 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896814 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.896903 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.897118 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.897205 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.897421 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.897550 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.897725 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.897822 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898029 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898114 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898335 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898444 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898665 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898766 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.898968 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.899054 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.899284 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.899370 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.899600 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.899690 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.899911 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900004 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900216 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900310 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900538 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900624 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900853 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.900950 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.901160 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.901257 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.901466 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.901552 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.901781 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.901868 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.902087 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.902188 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.902413 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.902506 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.902717 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.902805 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903039 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903141 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903345 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903430 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903654 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903748 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903900 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.903987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.904200 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.904290 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.904501 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.904587 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.904816 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.904915 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.905117 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.905212 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.905417 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.905503 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.905716 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.905804 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906011 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906099 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906314 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906417 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906638 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906730 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.906940 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907028 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907240 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907332 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907539 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907634 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907838 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.907926 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.908138 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.908236 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.908440 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.908525 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.908740 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.908825 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909041 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909136 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909348 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909444 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909647 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909768 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.909993 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.910177 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.910423 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.910536 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.910758 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.910861 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911069 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911177 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911377 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911474 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911700 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911813 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.911992 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.912103 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.912294 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.912389 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.912597 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.912694 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.912902 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913010 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913211 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913305 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913515 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913611 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913819 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.913918 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.914187 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.914333 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.914468 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.914590 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.914747 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.914871 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915050 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915172 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915354 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915475 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915655 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915770 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.915959 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.916073 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.916260 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.916375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.916563 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.916686 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.918960 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919099 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919225 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919337 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919457 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919574 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919687 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919794 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919794 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.919991 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920107 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920213 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920331 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920446 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920446 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920649 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920756 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920860 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.920860 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.921066 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.921171 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.921284 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.921398 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.921504 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.921608 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:23:59.921713 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.921864 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.921985 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922102 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922419 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922549 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922634 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922727 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922816 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922896 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922974 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.922974 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923194 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923283 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923369 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923447 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923525 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923608 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923696 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923776 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923853 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.923930 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924008 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924187 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924341 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924503 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924616 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924818 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.924907 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.925136 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.925242 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.926023 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.926112 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.926503 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.926595 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.926828 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.926930 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.927153 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.927253 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.927469 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.927564 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.927787 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.927887 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.928119 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.928206 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.928441 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.928528 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.928753 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.928841 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.929095 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.929182 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.929408 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.929501 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.929721 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.929818 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.930033 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.930122 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.930385 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.930493 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.930694 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.930783 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931006 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931092 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931323 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931409 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931633 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931720 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.931945 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932039 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932254 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932352 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932566 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932654 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932876 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.932961 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.933189 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.933290 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.933503 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.933590 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.933812 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.933900 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.934118 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.934213 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.934457 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.934550 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.934769 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.934868 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935077 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935174 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935386 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935473 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935688 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935774 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.935993 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936096 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936296 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936384 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936604 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936690 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936907 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.936994 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.937210 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.937295 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.937516 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.937602 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.937826 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.937920 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.938129 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.938214 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.938467 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.938556 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.938781 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.938872 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.939092 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.939177 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.939401 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.939495 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.939705 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.939794 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.940015 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.940102 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.940325 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.940419 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.940630 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.940717 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.941059 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.941670 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.941861 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942008 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942176 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942264 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942510 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942602 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942823 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.942932 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.943130 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.943219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.943435 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.943532 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.943749 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.943846 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944054 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944139 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944361 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944448 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944674 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944767 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.944988 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.945075 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.945296 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.945382 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.945605 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.945693 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.945919 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946014 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946245 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946332 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946573 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946663 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946884 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.946977 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.947206 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.947311 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.947522 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.947610 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.947827 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.947926 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.948139 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.948242 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.948444 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.948540 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.948748 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.948836 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949052 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949148 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949363 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949457 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949665 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949752 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.949967 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950063 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950272 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950381 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950599 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950685 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950904 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.950992 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.951215 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.951303 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.951518 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.951605 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.951818 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.951905 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.952120 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.952213 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.952420 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.952554 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.952740 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.952862 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953042 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953130 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953346 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953435 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953649 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953738 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.953990 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.954078 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.954298 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.954425 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.954637 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.954732 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.954954 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955052 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955265 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955368 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955575 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955664 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955884 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.955982 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.956194 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.956295 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.956505 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.956667 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.956848 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.956975 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.957154 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.957269 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.957467 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.957567 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.957788 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.957880 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.958099 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.958196 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.958444 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.958537 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.958760 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.958849 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.959079 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.959174 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.959388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.959481 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.959711 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.959798 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960017 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960106 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960334 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960421 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960640 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960725 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.960958 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961054 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961269 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961357 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961579 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961673 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961887 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.961977 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.962207 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.962309 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.962537 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.962639 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.962850 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.962977 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.963160 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.963247 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.963474 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.963575 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.963793 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.963880 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.964103 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.964199 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.964420 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.964517 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.964723 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.964819 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965035 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965130 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965346 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965443 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965669 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965764 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.965970 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.966064 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.966280 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.966409 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.966623 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.966712 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.966933 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967021 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967241 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967332 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967553 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967643 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967854 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.967941 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.968157 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.968257 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.968467 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.968555 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.968778 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.968872 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.969084 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.969175 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.969390 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.969479 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.969691 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.969778 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970003 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970101 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970307 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970415 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970643 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970742 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.970942 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971030 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971251 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971342 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971558 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971652 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971862 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.971949 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.972709 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.972860 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973023 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973148 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973348 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973449 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973658 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973746 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.973981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.974083 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.974305 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.974425 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.974637 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.974726 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.974940 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975035 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975241 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975332 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975560 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975646 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975864 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.975954 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.976162 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.976247 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.976464 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.976550 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.976786 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.976873 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.977094 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.977181 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.977394 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.977487 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.977973 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.978067 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.978297 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.978490 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.978635 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.978734 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.978950 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979037 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979256 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979341 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979564 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979662 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979872 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.979960 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.980178 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.980265 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.980484 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.980580 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.980794 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.980888 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.981100 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.981187 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.981407 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.981507 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.981714 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.981802 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982016 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982112 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982324 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982433 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982658 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982786 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.982970 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.983226 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.983331 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.983565 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.983653 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.983881 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.983970 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.984200 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.984443 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.984538 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.984774 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.984861 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.985090 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.985177 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.985414 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.985510 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.985733 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.985828 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986055 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986153 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986376 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986479 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986687 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986775 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.986991 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.987081 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.987302 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.987405 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.987608 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.987745 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.988493 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.988633 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.988807 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.988953 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.989108 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.989199 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.989410 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.989495 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.989710 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.989805 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990012 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990101 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990314 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990436 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990644 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990740 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.990945 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991032 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991249 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991336 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991549 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991652 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991869 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.991974 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.992174 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.992260 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.992472 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.992571 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.992774 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.992906 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.993075 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.993163 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.993393 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.993536 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.993696 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.993838 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994004 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994174 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994308 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994525 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994676 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994865 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.994984 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.995170 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.995323 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.995474 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.995653 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.995794 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.995996 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.996091 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.996306 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.996395 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.996614 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.996702 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.996936 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997033 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997242 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997329 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997548 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997635 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997852 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.997952 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.998155 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.998241 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.998487 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.998580 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.998792 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.998891 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.999090 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.999177 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.999397 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.999483 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.999696 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:23:59.999793 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000005 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000093 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000307 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000394 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000609 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000699 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000911 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.000996 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.001217 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.001313 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.001526 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.001613 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.001826 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.001912 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.002128 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.002213 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.002450 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.002540 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.002769 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.002873 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.003071 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.003161 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.003376 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.003559 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.003700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.003818 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004000 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004100 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004309 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004397 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004611 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004696 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.004917 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005015 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005229 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005317 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005531 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005617 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005833 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.005929 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.006141 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.006235 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.006470 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.006574 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.006775 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.006872 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007079 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007165 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007389 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007483 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007693 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007782 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.007995 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008081 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008304 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008391 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008603 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008698 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008906 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.008995 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.009209 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.009309 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.009516 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.009611 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.009816 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.009903 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.010116 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.010203 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.010442 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.010544 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.010746 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.010832 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011048 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011143 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011352 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011441 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011655 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011744 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.011957 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012053 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012258 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012351 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012556 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012642 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012876 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.012974 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.013180 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.013272 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.013485 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.013573 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.013788 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.013885 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.014131 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.014218 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.014457 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.014546 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.014773 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.014862 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.015079 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.015174 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.015389 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.015478 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.015691 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.015780 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016004 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016091 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016312 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016405 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016619 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016707 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.016920 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017016 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017221 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017309 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017527 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017615 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017833 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.017928 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.018136 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.018225 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.018461 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.018554 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.018783 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.018871 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.019127 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.019262 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.019432 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.019561 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.019736 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.019854 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020046 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020170 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020353 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020443 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020657 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020744 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.020963 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021059 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021270 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021357 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021576 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021663 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021881 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.021979 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.022190 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.022295 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.022516 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.022607 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.022821 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.022912 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.023128 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.023221 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.023439 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.023527 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.023739 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.023839 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024041 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024129 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024352 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024440 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024652 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024740 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.024955 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025040 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025279 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025371 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025590 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025679 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025895 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.025984 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.026206 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.026326 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.026538 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.026661 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.026851 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.026971 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.027157 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.027257 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.027568 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.027654 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.027875 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.027971 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.028183 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.028278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.028487 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.028575 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.028789 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.028875 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.029096 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.029255 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.029410 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.029499 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.029723 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.029810 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030027 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030117 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030384 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030475 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030688 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030785 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.030997 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.031088 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.031317 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.031404 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.031619 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.031708 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.031919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032008 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032219 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032314 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032535 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032624 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032836 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.032923 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.033141 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.033228 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.033446 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.033543 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.033766 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.033868 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.034069 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.034165 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.034409 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.034572 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.035414 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.035501 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.035737 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.035886 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.036047 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.036214 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.036464 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.036552 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.036779 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.036866 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.037094 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.037182 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.037417 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.037511 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.037734 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.037841 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.038057 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.038146 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.038391 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.038498 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.038695 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.038782 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039003 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039088 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039302 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039389 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039710 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.039934 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040028 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040242 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040332 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040545 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040630 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040868 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.040956 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.041191 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.041280 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.041503 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.041598 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.041825 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.041914 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.042154 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.042242 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.042486 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.042584 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.042788 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.042904 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.043098 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.043187 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.043398 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.043488 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.043700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.043838 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044026 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044127 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044331 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044422 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044642 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044739 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.044949 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045039 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045259 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045348 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045561 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045707 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045863 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.045959 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.046170 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.046270 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.046495 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.046586 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.046803 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.046903 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.047109 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.047197 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.047427 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.047522 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.047729 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.047815 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048033 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048121 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048353 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048440 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048660 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048755 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.048960 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049048 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049262 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049352 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049561 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049651 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049885 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.049981 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.050186 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.050300 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.051111 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.051215 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.051424 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.051521 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.051770 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.051859 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.052079 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.052167 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.052410 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.052508 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.052744 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.052831 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.053063 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.053152 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.053377 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.053473 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.053698 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.053785 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054003 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054091 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054305 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054456 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054648 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054737 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.054950 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055055 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055255 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055345 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055558 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055644 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055864 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.055955 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.056167 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.056257 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.056467 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.056554 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.056769 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.056864 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057079 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057168 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057380 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057468 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057680 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057775 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.057985 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.058073 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.058285 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.058391 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.058614 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.058719 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.058915 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059004 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059232 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059536 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059634 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059845 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.059933 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.060150 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.060290 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.060470 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.060559 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.060782 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.060871 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.061094 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.061181 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.061403 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.061490 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.061717 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.061803 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062032 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062126 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062343 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062476 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062675 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062763 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.062986 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.063082 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.063300 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.063387 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.063612 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.063698 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.063924 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.064047 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.064237 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.064447 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.064543 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.064772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.064860 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.065086 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.065176 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.065398 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.065664 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.065760 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066047 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066146 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066374 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066471 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066717 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066908 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.066990 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.067084 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.067300 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.067437 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.067609 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.067701 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.067932 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068023 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068253 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068342 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068577 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068675 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068888 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.068977 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.069213 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.069300 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.069524 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.069613 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.069837 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.069930 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.070150 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.070247 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.070498 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.070604 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.070821 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.070910 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.071126 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.071222 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.071440 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.071536 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.071751 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.071837 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072061 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072149 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072369 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072459 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072676 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072763 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.072986 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.073085 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.073298 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.073388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.073606 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.073699 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.073914 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074002 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074225 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074314 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074560 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074648 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074878 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.074979 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.075194 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.075345 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.075510 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.075599 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.075818 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.075916 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.076129 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.076219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.076441 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.076530 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.076767 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.076958 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.077084 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.077276 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.077399 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.077611 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.077712 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.077936 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.078219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.078307 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.078562 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.078691 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.078887 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.078985 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.079214 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.079303 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.079520 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.079608 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.079824 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.079914 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.080135 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.080223 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.080445 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.080543 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.080747 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.080844 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.081050 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.081137 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.081363 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.081466 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.081698 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.081931 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082028 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082109 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082332 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082479 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082667 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082864 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.082964 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.083275 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.083364 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.083588 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.083685 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.083913 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.084122 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.084260 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.084472 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.084566 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.084790 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.084879 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.085118 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.085206 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.085439 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.085535 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.085744 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.085832 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086048 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086133 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086370 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086462 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086678 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086780 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.086982 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.087071 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.087291 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.087388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.087599 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.087686 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.087900 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088000 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088206 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088293 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088504 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088591 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088819 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.088924 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.089122 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.089210 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.089426 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.089522 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.089725 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.089822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090033 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090127 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090335 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090446 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090655 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090756 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.090957 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.091046 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.091258 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.091348 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.091560 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.091655 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.091861 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092012 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092165 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092252 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092465 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092553 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092771 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.092859 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093072 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093158 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093377 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093464 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093677 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093765 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.093984 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.094069 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.094290 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.094484 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.094626 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.094712 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.094935 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095041 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095253 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095346 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095556 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095642 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095868 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.095967 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.096175 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.096264 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.096506 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.096592 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.096820 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.096916 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.097664 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.097971 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.098061 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.098318 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.098523 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.098661 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.098847 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.098984 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.099312 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.099399 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.099619 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.099719 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.099924 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100020 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100230 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100341 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100554 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100689 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100867 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.100967 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.101177 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.101274 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.101486 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.101595 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.101795 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.101884 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.102104 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.102192 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.102437 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.102531 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103012 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103106 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103325 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103433 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103635 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103731 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.103942 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104030 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104256 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104354 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104564 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104656 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104871 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.104959 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.105179 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.105275 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.105489 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.105576 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.105800 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.105887 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.106113 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.106210 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.106445 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.106547 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.106762 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.106850 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107076 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107173 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107381 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107472 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107686 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107775 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.107992 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.108082 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.108297 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.108385 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.108608 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.108706 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.108918 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109003 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109229 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109316 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109528 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109623 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109843 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.109937 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.110172 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.110261 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.110513 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.110620 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.110822 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.110910 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.111172 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.111259 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.111489 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.111579 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.111809 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.111906 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.112118 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.112207 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.112438 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.112535 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.112748 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.112879 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.113770 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.113865 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.114110 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.114200 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.114470 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.114606 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.114796 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.114897 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.115101 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.115191 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.115406 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.115494 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.115709 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.115807 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116019 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116134 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116333 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116429 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116639 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116737 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.116941 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117030 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117241 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117329 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117551 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117649 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117851 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.117939 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.118150 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.118245 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.118472 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.118567 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.118776 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.118864 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119083 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119216 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119383 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119474 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119683 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119773 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.119984 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120081 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120284 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120582 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120677 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120884 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.120983 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.121190 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.121280 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.121489 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.121588 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.121792 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.121888 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.122089 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.122177 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.122407 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.122543 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.122709 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.122812 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123012 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123099 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123319 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123407 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123631 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123733 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.123936 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124024 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124260 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124400 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124713 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124886 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.124975 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.125204 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.125292 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.125514 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.125602 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.125823 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.125909 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.126137 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.126224 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.126484 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.126590 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.126810 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.126899 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.127125 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.127220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.127438 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.127528 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.127745 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.127831 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.128055 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.128159 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.128364 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.128472 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.128806 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.128895 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.129133 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.129294 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.129441 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.129538 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.129755 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.129846 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.130068 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.130173 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.130411 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.130518 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.130722 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.130809 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131028 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131124 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131355 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131450 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131663 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131751 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.131973 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132062 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132281 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132369 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132588 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132676 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132895 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.132985 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.133207 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.133303 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.133515 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.133612 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.133821 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.133912 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.134129 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.134227 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.134468 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.134574 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.134783 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.134872 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.135094 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.135191 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.135400 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.135496 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.135718 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.135805 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.136039 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.136126 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.136364 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.136459 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.136677 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.136764 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137004 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137089 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137416 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137641 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137742 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.137950 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.138039 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.138256 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.138346 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.138520 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:24:00.138645 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.138965 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.139279 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.139588 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:00.139833 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:24:00.292705 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Registered counter for database nova_api Aug 08 02:24:00.293079 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Registered counter for database nova_api Aug 08 02:24:00.314485 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.316260 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.321345 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.322825 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.377324 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.context [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5baaec13-31d8-4da8-83a2-55eae616e5e0(cell1) {{(pid=103524) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:24:00.379636 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.context [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5baaec13-31d8-4da8-83a2-55eae616e5e0(cell1) {{(pid=103523) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:24:00.381337 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:00.381817 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:00.383419 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:00.383527 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:00.383942 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:00.384151 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:00.384598 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:00.385506 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:00.386261 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:00.386608 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:00.386725 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:00.388583 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Registered counter for database nova_cell0 Aug 08 02:24:00.388757 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:00.390758 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Registered counter for database nova_cell0 Aug 08 02:24:00.394561 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Registered counter for database nova_cell1 Aug 08 02:24:00.396840 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Registered counter for database nova_cell1 Aug 08 02:24:00.402104 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.405529 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.405910 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.406448 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.407557 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.415619 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.417062 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.547928 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.557180 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Registered counter for database nova_cell0 Aug 08 02:24:00.560514 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Registered counter for database nova_cell0 Aug 08 02:24:00.564446 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.569596 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.569733 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:00.573999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:00.983777 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:00.991769 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:00.999126 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:01.006369 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:01.334143 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:01.340124 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:01.345361 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ceece3e9c0 pid: 103524 (default app) Aug 08 02:24:01.347719 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:24:01.348860 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001950 Aug 08 02:24:01.349099 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:01.349273 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Aug 8 02:24:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:24:01.355365 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-691d0cd6-7829-42b3-af47-a8259c483ebd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:01.360584 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ceece3e9c0 pid: 103523 (default app) Aug 08 02:25:20.014122 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:20.015176 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 08 02:25:20.015723 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:20.027651 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:20.028622 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:20.029634 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:20.030449 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:20.889187 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-24efd929-a86b-4c88-9a9e-56aa34b2d825 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:20.927788 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-24efd929-a86b-4c88-9a9e-56aa34b2d825 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905269 Aug 08 02:25:20.928576 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 02:25:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:23.152864 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:23.153865 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-30caf1d7-4ec6-41bb-b956-bb07d53827c5 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 08 02:25:23.154264 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:23.622675 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-113972fa-05c6-4cfa-890a-f40216f0e638 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "swap": 0, "name": "cirros256", "vcpus": 1}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:23.650122 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:23.650122 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 08 02:25:23.731490 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-113972fa-05c6-4cfa-890a-f40216f0e638 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.570278 Aug 08 02:25:23.737397 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:23.746018 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.747496 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.748362 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell1:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.749101 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.954628 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-b38057f0-47b7-4b02-89b6-4dcffcdaf468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:23.958969 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:23.958969 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 08 02:25:24.104028 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-b38057f0-47b7-4b02-89b6-4dcffcdaf468 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.363191 Aug 08 02:25:24.105066 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 02:25:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:26.338661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-113972fa-05c6-4cfa-890a-f40216f0e638 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:26.339679 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-113972fa-05c6-4cfa-890a-f40216f0e638 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Aug 08 02:25:26.340087 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:26.995039 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-5ce96fb3-c7a1-4067-932c-780f593f5fb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:27.015613 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:27.015613 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 08 02:25:27.145794 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-5ce96fb3-c7a1-4067-932c-780f593f5fb4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.798911 Aug 08 02:25:27.146576 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:27.159839 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-d93e237b-6f88-428a-92c5-edfe55c8e753 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:27.162824 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:25:27.162824 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 08 02:25:27.275635 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-d93e237b-6f88-428a-92c5-edfe55c8e753 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119841 Aug 08 02:25:27.276470 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 02:25:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:29.578138 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-5ce96fb3-c7a1-4067-932c-780f593f5fb4 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:29.579722 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-5ce96fb3-c7a1-4067-932c-780f593f5fb4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Aug 08 02:25:29.580124 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:29.979631 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ffc9673f-4cf6-4f2c-9837-22b3f2a14667 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:30.059627 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-ffc9673f-4cf6-4f2c-9837-22b3f2a14667 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473581 Aug 08 02:25:30.060188 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:30.072278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-4938f8b2-912d-4db3-bda8-59ffe271eb78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:30.170259 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-4938f8b2-912d-4db3-bda8-59ffe271eb78 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101566 Aug 08 02:25:30.170815 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 02:25:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:32.397934 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ffc9673f-4cf6-4f2c-9837-22b3f2a14667 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:32.399015 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-ffc9673f-4cf6-4f2c-9837-22b3f2a14667 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 08 02:25:32.399441 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:32.870131 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-3309a483-f6f1-4c3f-80ef-b90f37a4c692 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:32.951471 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-3309a483-f6f1-4c3f-80ef-b90f37a4c692 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546173 Aug 08 02:25:32.952256 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:32.965340 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-c4f00b5d-4c3a-4fb0-be31-f83983510a6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:33.075009 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-c4f00b5d-4c3a-4fb0-be31-f83983510a6e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113446 Aug 08 02:25:33.077604 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 02:25:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:35.278616 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-3309a483-f6f1-4c3f-80ef-b90f37a4c692 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:35.279621 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-3309a483-f6f1-4c3f-80ef-b90f37a4c692 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 08 02:25:35.280019 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:35.712749 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8c25c6ba-9b9f-4095-a28a-87625d47eb63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:35.791455 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8c25c6ba-9b9f-4095-a28a-87625d47eb63 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504171 Aug 08 02:25:35.792027 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:35.804399 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-79a8dc28-1a04-4d29-81a8-fa7f018a6ffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:35.893164 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-79a8dc28-1a04-4d29-81a8-fa7f018a6ffc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092295 Aug 08 02:25:35.893696 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 02:25:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:38.407296 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8c25c6ba-9b9f-4095-a28a-87625d47eb63 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:38.408319 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8c25c6ba-9b9f-4095-a28a-87625d47eb63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Aug 08 02:25:38.408750 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:38.831191 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-cd12a2fe-fe97-45e8-bc96-73cc58df592a admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:38.856124 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-cd12a2fe-fe97-45e8-bc96-73cc58df592a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441116 Aug 08 02:25:38.856717 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 02:25:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:25:41.680270 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8c25c6ba-9b9f-4095-a28a-87625d47eb63 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:41.681621 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8c25c6ba-9b9f-4095-a28a-87625d47eb63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Aug 08 02:25:41.682328 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:42.126206 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-eda25577-fe45-4bbe-82df-a31ad5d0670e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:42.203743 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-eda25577-fe45-4bbe-82df-a31ad5d0670e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.514432 Aug 08 02:25:42.204392 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:25:42.216905 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-83191358-805a-4111-b8e8-8268e4ae8f45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:42.302320 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-83191358-805a-4111-b8e8-8268e4ae8f45 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089177 Aug 08 02:25:42.302954 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 02:25:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:44.462039 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-eda25577-fe45-4bbe-82df-a31ad5d0670e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:44.463175 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-eda25577-fe45-4bbe-82df-a31ad5d0670e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 08 02:25:44.463497 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:44.877834 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cfd84269-6d9f-4dd1-8e46-30c479a2186c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "swap": 0}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:45.031605 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cfd84269-6d9f-4dd1-8e46-30c479a2186c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.561247 Aug 08 02:25:45.032349 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:45.044404 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-76186521-dcee-443f-b713-3d3cf6160a1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:45.205998 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-76186521-dcee-443f-b713-3d3cf6160a1d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165225 Aug 08 02:25:45.206650 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 02:25:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:47.429649 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cfd84269-6d9f-4dd1-8e46-30c479a2186c admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:47.431341 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cfd84269-6d9f-4dd1-8e46-30c479a2186c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 08 02:25:47.436709 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:47.880998 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-de506081-40c1-4cfc-a01f-20b86421f8c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:47.957170 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-de506081-40c1-4cfc-a01f-20b86421f8c8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.518719 Aug 08 02:25:47.957720 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:47.970826 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-47412508-dd8a-4da0-a1cb-14b9d4d68368 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:48.066252 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-47412508-dd8a-4da0-a1cb-14b9d4d68368 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099263 Aug 08 02:25:48.067182 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 02:25:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:50.299603 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-de506081-40c1-4cfc-a01f-20b86421f8c8 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:50.300615 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-de506081-40c1-4cfc-a01f-20b86421f8c8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 08 02:25:50.301059 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:50.764925 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-7b0c3879-0d6c-4ae1-9166-10db87bb4124 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:50.770839 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:50.840556 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-7b0c3879-0d6c-4ae1-9166-10db87bb4124 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.533225 Aug 08 02:25:50.849223 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:25:50.854628 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e93a8da2-da32-4bf2-b254-1c7a34b2b100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:50.945994 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-e93a8da2-da32-4bf2-b254-1c7a34b2b100 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095203 Aug 08 02:25:50.962388 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 02:25:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:53.240055 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-7b0c3879-0d6c-4ae1-9166-10db87bb4124 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:53.241063 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-7b0c3879-0d6c-4ae1-9166-10db87bb4124 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 08 02:25:53.241612 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:53.681520 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-033e3866-e6d5-4186-ad76-f61b53793619 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "vcpus": 8, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:53.756272 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-033e3866-e6d5-4186-ad76-f61b53793619 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.508983 Aug 08 02:25:53.756939 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 02:25:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:25:53.769917 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f9ae3c5f-dad0-49fb-9147-e8e7c5c727ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:53.886500 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f9ae3c5f-dad0-49fb-9147-e8e7c5c727ec admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121150 Aug 08 02:25:53.887008 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 02:25:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:13.131749 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-033e3866-e6d5-4186-ad76-f61b53793619 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:13.132761 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-033e3866-e6d5-4186-ad76-f61b53793619 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 08 02:26:13.133162 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:13.520787 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-91094955-cd23-4e88-90b2-6f28f5df76b4 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:13.539069 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-91094955-cd23-4e88-90b2-6f28f5df76b4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399687 Aug 08 02:26:13.539603 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 02:26:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:26:14.594309 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-033e3866-e6d5-4186-ad76-f61b53793619 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:14.595339 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-033e3866-e6d5-4186-ad76-f61b53793619 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 08 02:26:14.595738 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:15.114196 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f71bd17b-745d-48d6-bef8-07cb1daf2005 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.119683 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-f71bd17b-745d-48d6-bef8-07cb1daf2005 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f71bd17b-745d-48d6-bef8-07cb1daf2005 admin admin] Request method failure captured: Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Host: 10.222.0.15 Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi8HRG-NmDx2cxRUPCIwTH1WXNSVaQInwFQ1hcXCKj8C_31S1zUmqhfSlKg-MKHIalW7rnN2uF_x2ZjP4YWw6ceBz9UvYAOltiQubaOuLBEkj7n2UV8scGvPw2D5s-dJLaKbGP5xDoPnToMhyZH6_rn4ZHaCOVuTz_jawiaPe6IUqLdEU Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Role: admin,member,reader Aug 08 02:26:15.122901 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Roles: admin,member,reader Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User: admin Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Id: c5565152ee164c0da536fef7f9cd3d6c Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: method: > Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: exception: Flavor 42 could not be found. Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: action_args: {'id': '42'} Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:26:15.124799 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:15.125671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.126981 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f71bd17b-745d-48d6-bef8-07cb1daf2005 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:26:15.128219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f71bd17b-745d-48d6-bef8-07cb1daf2005 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391889 Aug 08 02:26:15.128219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 02:26:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 08 02:26:15.134751 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e421076a-7e73-4ded-9f06-d1ade7d1ad10 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.139606 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:15.158492 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-e421076a-7e73-4ded-9f06-d1ade7d1ad10 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027193 Aug 08 02:26:15.159026 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 02:26:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:26:15.168631 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-3b46761c-7476-44a3-9b65-44ec76071b92 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.192462 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-3b46761c-7476-44a3-9b65-44ec76071b92 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027371 Aug 08 02:26:15.192991 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 02:26:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:26:15.203276 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-387a1768-daef-4647-81e3-d23f8552cab3 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.208846 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-387a1768-daef-4647-81e3-d23f8552cab3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-387a1768-daef-4647-81e3-d23f8552cab3 admin admin] Request method failure captured: Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Accept: application/json Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Connection: keep-alive Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Content-Length: 0 Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Host: 10.222.0.15 Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi8HRG-NmDx2cxRUPCIwTH1WXNSVaQInwFQ1hcXCKj8C_31S1zUmqhfSlKg-MKHIalW7rnN2uF_x2ZjP4YWw6ceBz9UvYAOltiQubaOuLBEkj7n2UV8scGvPw2D5s-dJLaKbGP5xDoPnToMhyZH6_rn4ZHaCOVuTz_jawiaPe6IUqLdEU Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Role: admin,member,reader Aug 08 02:26:15.212220 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Roles: admin,member,reader Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant: admin Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User: admin Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Id: c5565152ee164c0da536fef7f9cd3d6c Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Name: admin Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: method: > Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: exception: Flavor 42 could not be found. Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: action_args: {'id': '42'} Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:26:15.218904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:15.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:15.221278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-387a1768-daef-4647-81e3-d23f8552cab3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:26:15.222596 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-387a1768-daef-4647-81e3-d23f8552cab3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014863 Aug 08 02:26:15.222596 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 02:26:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:16.176765 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-3b46761c-7476-44a3-9b65-44ec76071b92 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.177726 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-3b46761c-7476-44a3-9b65-44ec76071b92 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 08 02:26:16.178117 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:16.705389 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-24f6cfc7-0006-4d68-8e2c-4337e154e8b6 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.710764 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-24f6cfc7-0006-4d68-8e2c-4337e154e8b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-24f6cfc7-0006-4d68-8e2c-4337e154e8b6 admin admin] Request method failure captured: Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Accept: application/json Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Connection: keep-alive Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Content-Length: 0 Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Host: 10.222.0.15 Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi8HRImAZf9buo0IbzQfZ1qcSymtNt-3oWQlEktVDfKHWxLt0mT2klBzIeccMx4K8bo_XJqQT006bn8YAZbztB6zp7GzKciz521CG9k1KVoFEejmuIKicZAZ2rrS9hBpWj8gx_-oDh3NN1EoNNOf4lRleQd6RTd4GBITObbg5zsWEhmus Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Role: admin,member,reader Aug 08 02:26:16.712234 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Roles: admin,member,reader Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant: admin Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User: admin Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Id: c5565152ee164c0da536fef7f9cd3d6c Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Name: admin Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: method: > Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: exception: Flavor 84 could not be found. Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: action_args: {'id': '84'} Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:26:16.713772 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:16.714622 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.715700 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-24f6cfc7-0006-4d68-8e2c-4337e154e8b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:26:16.717334 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-24f6cfc7-0006-4d68-8e2c-4337e154e8b6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394952 Aug 08 02:26:16.717334 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:16.724344 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-12a49081-6114-4355-8770-079774c71921 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.739697 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-12a49081-6114-4355-8770-079774c71921 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019241 Aug 08 02:26:16.740221 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:26:16.749434 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-35bb72b2-e27b-4e3d-a8f9-b443eaff3f61 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.764194 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-35bb72b2-e27b-4e3d-a8f9-b443eaff3f61 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018168 Aug 08 02:26:16.764745 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:26:16.773646 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ab9ad340-c836-4b56-8254-d5e4b4265eb4 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.778865 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-ab9ad340-c836-4b56-8254-d5e4b4265eb4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ab9ad340-c836-4b56-8254-d5e4b4265eb4 admin admin] Request method failure captured: Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Host: 10.222.0.15 Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi8HRImAZf9buo0IbzQfZ1qcSymtNt-3oWQlEktVDfKHWxLt0mT2klBzIeccMx4K8bo_XJqQT006bn8YAZbztB6zp7GzKciz521CG9k1KVoFEejmuIKicZAZ2rrS9hBpWj8gx_-oDh3NN1EoNNOf4lRleQd6RTd4GBITObbg5zsWEhmus Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Role: admin,member,reader Aug 08 02:26:16.780848 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Roles: admin,member,reader Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User: admin Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Id: c5565152ee164c0da536fef7f9cd3d6c Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: method: > Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: exception: Flavor 84 could not be found. Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: action_args: {'id': '84'} Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:26:16.782388 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:16.783375 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:16.784661 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ab9ad340-c836-4b56-8254-d5e4b4265eb4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:26:16.785974 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-ab9ad340-c836-4b56-8254-d5e4b4265eb4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011980 Aug 08 02:26:16.785974 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:17.867325 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-35bb72b2-e27b-4e3d-a8f9-b443eaff3f61 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:17.868329 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-35bb72b2-e27b-4e3d-a8f9-b443eaff3f61 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 08 02:26:17.868747 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:18.405732 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-474fcc1e-185d-4530-aeec-cce4dcc3d039 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:18.411519 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-474fcc1e-185d-4530-aeec-cce4dcc3d039 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-474fcc1e-185d-4530-aeec-cce4dcc3d039 admin admin] Request method failure captured: Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Host: 10.222.0.15 Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi8HRJQGukKNayq7y3qe50t0BBk7qEiwv9Yr5T2YKW4Wa-JfL_cq8WQ15w7DydY8WIJuy0sGtZj-prj61jUBaSfiol9ZEoYRm0ZMhP-xRh4FkGxfDbm8QocHViVxdwzgqCLC9MhK6HC1KBcD9Qd1EG7Y8ds8kx8lzZ9KHg-szulKnztBQ Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Role: admin,member,reader Aug 08 02:26:18.412999 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Roles: admin,member,reader Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User: admin Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Id: c5565152ee164c0da536fef7f9cd3d6c Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: method: > Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: exception: Flavor 451 could not be found. Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: action_args: {'id': '451'} Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:26:18.414987 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:18.416219 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.417592 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-474fcc1e-185d-4530-aeec-cce4dcc3d039 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:26:18.418912 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-474fcc1e-185d-4530-aeec-cce4dcc3d039 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.407455 Aug 08 02:26:18.418912 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 02:26:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:18.425013 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e7b5176e-4b33-42fc-a596-573eeb27fafc admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:18.440592 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-e7b5176e-4b33-42fc-a596-573eeb27fafc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019171 Aug 08 02:26:18.441350 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 02:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:26:18.451659 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:18.467543 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019705 Aug 08 02:26:18.468123 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 02:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:26:18.482118 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f0ad3101-72b6-49f6-990b-a197962f2a45 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:18.489268 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-f0ad3101-72b6-49f6-990b-a197962f2a45 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f0ad3101-72b6-49f6-990b-a197962f2a45 admin admin] Request method failure captured: Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Accept: application/json Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Connection: keep-alive Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Content-Length: 0 Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Host: 10.222.0.15 Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi8HRJQGukKNayq7y3qe50t0BBk7qEiwv9Yr5T2YKW4Wa-JfL_cq8WQ15w7DydY8WIJuy0sGtZj-prj61jUBaSfiol9ZEoYRm0ZMhP-xRh4FkGxfDbm8QocHViVxdwzgqCLC9MhK6HC1KBcD9Qd1EG7Y8ds8kx8lzZ9KHg-szulKnztBQ Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Role: admin,member,reader Aug 08 02:26:18.490822 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Roles: admin,member,reader Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3e036fca31f44e57a9a6f1c124d31c6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant: admin Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant-Id: 3e036fca31f44e57a9a6f1c124d31c6b Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User: admin Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Id: c5565152ee164c0da536fef7f9cd3d6c Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: X-User-Name: admin Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: method: > Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: exception: Flavor 451 could not be found. Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: action_args: {'id': '451'} Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:26:18.492327 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:18.493301 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 08 02:26:18.494578 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f0ad3101-72b6-49f6-990b-a197962f2a45 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:26:18.495805 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-f0ad3101-72b6-49f6-990b-a197962f2a45 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014040 Aug 08 02:26:18.495805 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 02:26:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:26:19.475159 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:19.476171 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 08 02:26:19.476606 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:19.994486 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-8244b9fe-01be-4f98-b2f2-4a0449d1d3e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:20.067954 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-8244b9fe-01be-4f98-b2f2-4a0449d1d3e1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.454012 Aug 08 02:26:20.068513 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 02:26:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:26:21.048512 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:21.049520 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 08 02:26:21.049921 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:21.569904 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d4ea941b-474c-41cf-b58d-e9c5f5099f1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:21.645423 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d4ea941b-474c-41cf-b58d-e9c5f5099f1f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.456887 Aug 08 02:26:21.645971 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 02:26:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:26:22.610251 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:22.611280 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 08 02:26:22.611671 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:23.138002 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ea92bd4f-2f46-49c5-8593-427f70485919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:23.223733 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-ea92bd4f-2f46-49c5-8593-427f70485919 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.475681 Aug 08 02:26:23.224380 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 02:26:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:26:24.202229 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:24.203259 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Aug 08 02:26:24.203646 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:24.844599 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-37c68cfd-d916-42cf-971a-762459b9e788 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:24.909172 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-37c68cfd-d916-42cf-971a-762459b9e788 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.566512 Aug 08 02:26:24.909741 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 02:26:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:26:25.859951 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:25.860952 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 08 02:26:25.861343 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:26:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:26.388032 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-fa80853b-e130-4174-bc93-313bd07e9a1f admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:26.409165 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-fa80853b-e130-4174-bc93-313bd07e9a1f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407720 Aug 08 02:26:26.409710 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Aug 8 02:26:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:27:17.454707 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.455721 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-aea52ec7-0fda-4f5b-902c-d2f801243242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 08 02:27:17.456125 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:27:17.467137 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:17.840375 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-28d79477-3071-4d1e-9ae9-9bda287d7803 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.861257 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-28d79477-3071-4d1e-9ae9-9bda287d7803 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399199 Aug 08 02:27:17.861849 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:27:17.885481 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-90b3aac3-b34b-456b-aef9-d23857f67d0f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.889711 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:17.894656 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-90b3aac3-b34b-456b-aef9-d23857f67d0f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012782 Aug 08 02:27:17.895180 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:17.906853 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-40a8850f-e0b3-486b-b3c4-80a941ef1dd2 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.914880 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-40a8850f-e0b3-486b-b3c4-80a941ef1dd2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011610 Aug 08 02:27:17.915459 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:17.927284 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.935737 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012196 Aug 08 02:27:17.936258 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:17.947859 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ada1a23a-28c0-4597-b10d-b0db85ecc096 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.956311 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-ada1a23a-28c0-4597-b10d-b0db85ecc096 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012205 Aug 08 02:27:17.956828 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:18.176834 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:18.177847 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 08 02:30:18.178239 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:30:18.320952 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=6 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:18.476864 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:18.479209 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:30:18.479209 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 08 02:30:18.480358 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:18.480829 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:18.481253 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:18.481959 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:18.482456 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:18.482870 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:18.517487 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-60b80ceb-952a-4643-a493-adfe9c6c74c0 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198001 Aug 08 02:30:18.518041 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 02:30:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:30:19.345016 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:19.346029 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 08 02:30:19.346455 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:19.544049 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:19.546466 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:30:19.546466 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 08 02:30:19.547590 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:19.548072 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:19.548504 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:19.549226 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:19.549674 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:19.550094 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:19.569549 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-e195ecb2-1ac7-467a-9764-0f4223efca8b admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079823 Aug 08 02:30:19.570040 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 02:30:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:30:30.790709 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:30.791710 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 08 02:30:30.792101 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:30.936509 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=4 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:30.937237 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell1:SELECT=4 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:30.937887 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=8 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:30.985899 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:30.988260 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:30:30.988260 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 08 02:30:30.990013 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:30.990516 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:30.990946 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:30.991683 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:30.992231 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:30.992651 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:31.019159 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-f4c505b0-40b5-4be1-876e-546eecbbd3a9 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086938 Aug 08 02:30:31.019657 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 02:30:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:30:31.845415 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:31.846717 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-152abd01-919d-4cbc-8496-d6c572cad21f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 08 02:30:31.846975 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 02:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:32.039445 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:32.041818 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:30:32.041818 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 08 02:30:32.042996 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:32.043484 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:32.043919 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:32.044639 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:32.045093 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:32.045517 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:32.067174 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-059e4d7e-e899-4307-9e54-6e8592d4e8f8 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080442 Aug 08 02:30:32.068292 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 02:30:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:31:27.737731 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: Mon Aug 8 02:31:27 2022 - graceful shutdown triggered... Aug 08 02:31:27.738235 dv-cinder-852261-2-iscsi devstack@n-api.service[103523]: Gracefully killing worker 1 (pid: 103523)... Aug 08 02:31:27.737856 dv-cinder-852261-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 02:31:27.740278 dv-cinder-852261-2-iscsi devstack@n-api.service[103524]: Gracefully killing worker 2 (pid: 103524)... Aug 08 02:31:28.738881 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: worker 1 buried after 1 seconds Aug 08 02:31:28.739442 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: worker 2 buried after 1 seconds Aug 08 02:31:28.739442 dv-cinder-852261-2-iscsi devstack@n-api.service[103522]: goodbye to uWSGI. Aug 08 02:31:28.740481 dv-cinder-852261-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 02:31:28.741041 dv-cinder-852261-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 02:31:28.743888 dv-cinder-852261-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 02:31:28.754949 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:31:28 2022] *** Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: nodename: dv-cinder-852261-2-iscsi Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: machine: x86_64 Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: clock source: unix Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: pcre jit disabled Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: detected number of CPU cores: 4 Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: current working directory: / Aug 08 02:31:28.756923 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: your processes number limit is 47680 Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: your memory page size is 4096 bytes Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: detected max file descriptor number: 2048 Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: lock engine: pthread robust mutexes Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: thunder lock: enabled Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 02:31:28.757709 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:31:28.797395 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: Python main interpreter initialized at 0x561074cc49c0 Aug 08 02:31:28.797395 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: python threads support enabled Aug 08 02:31:28.797395 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: your server socket listen backlog is limited to 100 connections Aug 08 02:31:28.797395 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:31:28.797815 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:31:28.797815 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: *** Operational MODE: preforking *** Aug 08 02:31:28.798126 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:31:28.798126 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: spawned uWSGI master process (pid: 124643) Aug 08 02:31:28.798332 dv-cinder-852261-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 02:31:28.799101 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: spawned uWSGI worker 1 (pid: 124658, cores: 1) Aug 08 02:31:28.799779 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: spawned uWSGI worker 2 (pid: 124659, cores: 1) Aug 08 02:31:28.799779 dv-cinder-852261-2-iscsi devstack@n-api.service[124643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:31:29.471140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:31:29.476745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:31:30.640291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:31:30.640291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: from cryptography.utils import int_from_bytes Aug 08 02:31:30.640902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:31:30.640902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: from cryptography.utils import int_from_bytes Aug 08 02:31:30.687896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:31:30.687896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: from cryptography.utils import int_from_bytes Aug 08 02:31:30.688508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:31:30.688508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: from cryptography.utils import int_from_bytes Aug 08 02:31:33.004750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:31:33.005307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:31:33.005602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:31:33.005971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:31:33.006255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:31:33.006645 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.006988 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.007297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.007617 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.007949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.008274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.008589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.008906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.009232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.009496 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.009925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.010254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-2-iscsi {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.010607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.010919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.011231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.011549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.011855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.012181 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.012490 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.012986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.014323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.014323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.014323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.014770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.015012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.015326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.015705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.015958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.016281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.016658 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.017046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-2-iscsi {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.017382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.017694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.018007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.018466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.018784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.019100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.019409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.019746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.020059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.020390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.020713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.021031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.021355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.021661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.021971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.022286 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.022632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.022943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.023251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.023504 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.023814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.024136 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.024456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.024780 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.025035 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.025317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.025642 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.025965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.026288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.026619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.026934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.027245 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.027550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.027862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.028171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.028477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.028813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.029123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.029443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.029742 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.030071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.030559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.030817 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.031128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.031469 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.031790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.032101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.032423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.032747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.033056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.033366 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.033677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.033998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.034339 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.034672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.034927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.035238 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.035548 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.035871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.036180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.036494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.036810 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.037115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.037426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.037734 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.038048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.038653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.038919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.039232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.039542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.039853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.040162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.040482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.040804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.041783 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.042106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.042450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.042767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.043099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.043412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.043724 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.044051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.044363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.044685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.044993 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.045306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.045614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.045936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.046537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.046862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.047184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.047499 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.047809 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.048122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.048428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.048739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.049044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.049352 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.049660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.049964 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.050285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.050632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.050947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.051259 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.051568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.051890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.052233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.052568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.052918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.053238 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.053573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.053907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.054234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.054578 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.054897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.055250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.055544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.055860 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.056173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.057348 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.057465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.057714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.058131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.058480 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.058809 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.059132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.059454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.059786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.060116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.060434 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.060780 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.060875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:31:33.061277 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:31:33.061359 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.061443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.061630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:31:33.061726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.061961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:31:33.062058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.062213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:31:33.062487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.062679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.062762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.062961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.063121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.063286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.063429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.063586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.063741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.063910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.064058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.064210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.064366 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.064519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.064685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.064829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.064979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.065148 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.065313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.065465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.065615 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.065764 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.065913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.066063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-2-iscsi {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.066217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.066399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.066570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.066726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.066870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.067020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.067175 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.067330 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.067479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.067621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.067790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.067948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.068119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.068293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.068444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.068626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.068823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.069010 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.069183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.069338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.069500 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.069647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.069814 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.069972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.070117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.070271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.070499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.070649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.070801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.070945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.072144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.072321 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.072474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.072624 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.072778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.072923 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.073080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.073233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.073384 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-2-iscsi {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.073550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.073694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.073837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.073979 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.074121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.074270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.074466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.074619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.074769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.074912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.075053 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.075208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.075359 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.075513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.075664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.075807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.075949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.076102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.076245 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.076387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.076537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.076691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.076849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.077003 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.077155 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.077319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.077470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.077621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.077776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.077919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.078070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.078222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.078384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.078549 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.078706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.078910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.079068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.079660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.079840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.079992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.080152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.080305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.080456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.080599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.080750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.080895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.081048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.081231 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.082100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.082260 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.082455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.082618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.082775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.082919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.083064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.083206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.083358 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.083516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.083660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.083803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.083954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.084104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.084267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.084421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.084572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.084716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.084858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.085008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.085165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.085317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.085466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.085618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.085767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.085918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.086079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.086247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.086436 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.086586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.086729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.086881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.087031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.087193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.087337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.087487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.087637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.088031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.088185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.088354 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.088498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.088660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.089748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.089911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.090115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.090284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.090454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.090615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.090768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.090912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.091071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.091222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.091385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.092258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.092420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.092566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.092797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.092955 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.093108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.093251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.093403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.093556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.093556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.093851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.094112 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.094292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.094491 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.094640 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.094798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.094942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.095093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.095236 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.095379 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.095528 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.095681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.095843 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.096098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.096268 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.096444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.097132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.097288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.097432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.097583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.097728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.097873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.098026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.098170 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.098313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.098550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.098696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.098839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.099056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.101604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.102426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.102607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.102769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.102928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.103173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.103332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.103966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.104254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.104403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.104558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.104724 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.104885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.105031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.105189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.105370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.105518 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.105668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.105812 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.105970 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.106124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.106267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.106478 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.106574 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.106663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.106752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.106831 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.106922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.107007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.107097 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.107188 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.107283 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.107368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.107450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.107533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.107623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.107729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.107824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.107917 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.108000 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.108082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.108171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.108267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.108351 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.108441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.108524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.108606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.108688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.108783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.108881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.108972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.109571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.109684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.109780 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.109879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.109965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.110047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.110137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.110228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.110312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.110469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.110557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.110639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.110721 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.110802 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.110894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.110985 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.111075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.111248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111331 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:31:33.111428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.111875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.112643 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.112735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.112735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.112735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.112735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.113818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114725 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.114977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.115826 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.116119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.116218 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.116442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.116749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.116841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.117061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.117328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.117422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.117675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.117919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.118017 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.118316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.118538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.118660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.119066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.119729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.119900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.120228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.120331 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.120539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121746 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.121918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.122310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.122809 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.122992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.122992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.123167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.123259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.123350 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.123564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.123666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.123934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.124155 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.124327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.124543 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.124759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.124853 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.125164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.125327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.125475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.125789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.125894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.126538 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.126663 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.126760 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.126760 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.127053 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.127344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.127437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.127672 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.127942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.128035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.128275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.128521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.128614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.128892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.129117 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.129216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.129502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.129732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.129847 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.130130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.130296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.130470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.130788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.130878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.131123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.131403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.131493 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.131754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.132020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.132113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.132499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.132973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133079 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133341 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133584 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133689 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.133892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.134178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.134278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.134521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.134815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.134983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.135243 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.135539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.135696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.135835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.136044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.136198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.136449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.136599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.136751 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.136970 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.137123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.137406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.137544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.137763 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.137898 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.138115 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.138326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.138500 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.138784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.138940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.139124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.139286 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.139441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.139724 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.139862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.140063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.140326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.140425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.140682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.140902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.140995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.141299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.141488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.141614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.141936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.142073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.142250 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.142909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.143819 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.144127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.144329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.144429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.144773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.144862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.145109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.145397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.145497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.145740 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.145989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.146080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.146375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.146613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.146715 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.147758 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.147874 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148111 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148716 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.148834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.149107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.149302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.149403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.149734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.150941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151563 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151563 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.151840 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.152025 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.152154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.152480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153301 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153719 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153838 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.153976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.154192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.154285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.154617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.154777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.154930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.155242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.155341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.155550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.155834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.155935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.156164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.156416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.156510 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.156763 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.156986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.157094 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.157388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.157981 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158084 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158268 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.158953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.159235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.159328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.159669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.159831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.159988 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.160183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.160413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.160519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.160823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.160980 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.161155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.161432 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.161523 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.161751 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.162196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.162312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.162438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.162646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.163949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.164221 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.164325 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.164558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.164799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.164892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.165171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.165387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.165479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.165796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.167985 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168224 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168319 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168587 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.168769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.169027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.169179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.169361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.169677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.169768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.169998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.170252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.170369 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.170674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.170866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.171007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.172323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.173355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.173529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.173633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.173737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.173827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.173919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174294 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174507 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.174994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175790 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.175964 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176268 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176743 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.176919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.177980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.178204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.178306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.178551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.178644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.178865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.178956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.179176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.179270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.179489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.179596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.179794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.179886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.180108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.180210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.180417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.180510 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.180732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.180823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.181034 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.181136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.181335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.181429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.181731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.181873 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.182127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.182275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.182464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.182602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.182792 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.182899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.183113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.183206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.183438 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.183533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.183742 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.183839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184151 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184360 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184665 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184771 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.184972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185686 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.185984 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.186198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.186291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.186534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.186629 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.186841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.186931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.187143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.187235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.187453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.187555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.187756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.187855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.188973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.189073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.189279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.189372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.189582 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.189673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.189899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.190011 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.190184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.190282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.190539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.190723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.190849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191464 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191772 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.191952 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.192077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.192259 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.192390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.192572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.192713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.192891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.193031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.193194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.193338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.193607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.193708 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.193916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194227 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.194954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.195160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.195259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.195466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.195603 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.195770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.195863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.196075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.196378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.196680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.196874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.196997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.197273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.197432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.197606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.197750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.197927 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.198100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.198239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.198827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199168 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199798 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.199950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.200186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.200350 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.200505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.200668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.200828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.200933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201030 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.201918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.202137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.202237 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.202468 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.202602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.202871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.202977 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.203134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.203243 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204183 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204448 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.204904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205336 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.205950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.206989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.207190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.207283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.207496 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.207588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.207808 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.207909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.208110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.208208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.208418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.208518 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.208727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.208833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209034 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.209944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210680 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.210985 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.211199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.211288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.211513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.211606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.211813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.211919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.212124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.212216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.212427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.212526 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.213286 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.213596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.213761 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.214165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.214254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.214533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.214627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.214838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.214949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.215153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.215241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.215472 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.215573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.215794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.215887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.216120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.216250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.216429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.216530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.216764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.216857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.217080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.217174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.217394 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.217487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.217718 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.217813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218319 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218764 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.218964 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.219969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.220173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.220274 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.220474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.220568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.220775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.220867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.221094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.221197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.221395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.221496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.221714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.221806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.222021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.222206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.222324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.222572 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.222721 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.222891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223024 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223543 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223665 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.223976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.224177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.224274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.224495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.224578 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.224809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.224912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.225133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.225232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.225457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.225559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.225768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.225872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.226079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.226167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.226405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.226501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.226717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.226818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.227960 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.228053 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.228477 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.229128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.229468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.229583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.229714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.229815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.230047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.230149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.230370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.230465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.230689 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.230792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.231928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232865 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.232969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.233179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.233272 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.233489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.233581 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.233797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.233900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.234116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.234215 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.234441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.234539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.234771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.234863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.235087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.235177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.235413 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.235501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.235713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.235806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.236960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237365 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237570 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.237966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.238184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.238328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.238515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.238679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.238827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239785 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.239995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.240101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.240326 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.240419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.240644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.240737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.240970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.241076 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.241298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.241488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.241589 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.241801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.241908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.242128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.242230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.242472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.242581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.242794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.242901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.243109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.243202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.243421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.243553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.243726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.243824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244439 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.244971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.245075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.245271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.245401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.245586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.245716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.245892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.246027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.246192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.246339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.246514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.246675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.246821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.247032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.247339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.247430 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.247667 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.247768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.247979 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.248086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.248301 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.248392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.248617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.248709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.248928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249546 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249645 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.249938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.250150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.250256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.250485 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.250581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.250794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.250886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.251095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.251200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.251395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.251488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.251702 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.251797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252357 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.252998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.253206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.253297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.253504 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.253602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.253807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.253914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.254106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.254206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.254434 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.254539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.254739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.254836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255638 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.255948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256854 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.256947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.257162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.257255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.257463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.257571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.257767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.257867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.258068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.258161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.258403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.258511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.258707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.258801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.259058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.259165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.259373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.259475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.259719 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.259831 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260347 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260440 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.260973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.261077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.261289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.261383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.261605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.261816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.261923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.262145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.262237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.262485 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.262582 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.262816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.262929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.263142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.263236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.263444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.263536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.263747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.263850 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.264047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.264141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.264367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.264612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.264715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.264932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265029 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265874 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.265968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.266178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.266269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.266508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.266617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.266815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.266959 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.267122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.267225 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.267427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.267535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.267733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.267827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.268953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269056 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269686 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.269983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.270206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.270455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.270566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.270816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.270910 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.271134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.271226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.271441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.271541 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.271745 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.271839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272689 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.272992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.273086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.273307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.273397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.273627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.273719 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.273944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.274075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.274254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.274373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.274592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.274696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.274911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.275041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.275767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.275871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.276081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.276287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.276385 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.276470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.276692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.276785 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277731 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.277949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.278989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.279201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.279291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.279512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.279614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.279815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.279915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.280118 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.280202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.280420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.280511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.280727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.280821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.281946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282578 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.282988 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.283190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.283298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.283491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.283585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.283789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.283885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284088 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.284999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.285131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.285300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.285601 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.285689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.285900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.285998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.286224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.286382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.286574 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.286670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.286886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.286994 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.287204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.287306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.287511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.287604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.287829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.287932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.288135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.288228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.288452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.288545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.288831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.288935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.289081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.289173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.289384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.289475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.289694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.289794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.290008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.290102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.290312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.290423 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.290642 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.290737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.291561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.291735 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.291883 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.291991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.292216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.292317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.292531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.292625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.292849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.292962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.293165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.293259 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.293485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.293586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.293830 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.293937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.294149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.294287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.294486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.294583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.294798 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.294894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.295120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.295211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.295426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.295525 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.295736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.295868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296351 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296482 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.296976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.297077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.297284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.297392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.297590 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.297681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.297899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.298012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.298212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.298315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.298558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.298663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.298880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.299036 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.299185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.299353 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.299505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.299680 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.299825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.300957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.301138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.301287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.301449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.301634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.301758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.301963 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.302069 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.302287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:31:33.302415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.302622 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.302932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.303240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.303555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.303875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.304190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.304498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.304806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.305120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.305428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.305737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.306048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.306417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.306918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.307491 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.307919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.308236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.308555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.308870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.309182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.309502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.309814 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.310127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.310474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.310788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.311098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.311449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.311787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.312109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.312435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.312752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.313080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.313396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.313721 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.314048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.314436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.314717 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.315055 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.315372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.315689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.316004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.316319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.316635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.316950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.317286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.317619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.317933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.318264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.318613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.318945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.319266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.319582 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.319915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.320231 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.320546 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.320862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.321176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.321498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.321816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.322251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.322611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.322933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.323350 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.323689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.324020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.324335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.324664 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.324996 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.325355 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.325674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.326025 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.326382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.326703 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.327021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.327332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:31:33.327580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:31:33.455154 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO dbcounter [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Registered counter for database nova_api Aug 08 02:31:33.475506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_db.sqlalchemy.engines [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.480774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Registered counter for database nova_api Aug 08 02:31:33.482789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writer thread running {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.501280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.507813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.539133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.context [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5baaec13-31d8-4da8-83a2-55eae616e5e0(cell1) {{(pid=124658) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:31:33.543718 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:33.544239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:33.545799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:33.546554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:33.547001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:33.548995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:33.550955 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO dbcounter [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Registered counter for database nova_cell0 Aug 08 02:31:33.554983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO dbcounter [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Registered counter for database nova_cell1 Aug 08 02:31:33.563220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_db.sqlalchemy.engines [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.565319 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_db.sqlalchemy.engines [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.566330 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.context [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5baaec13-31d8-4da8-83a2-55eae616e5e0(cell1) {{(pid=124659) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:31:33.570468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:33.570715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writer thread running {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.570944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:33.572720 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:33.572852 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writer thread running {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.573458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:33.573908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:33.575962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:33.577973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Registered counter for database nova_cell0 Aug 08 02:31:33.582119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Registered counter for database nova_cell1 Aug 08 02:31:33.590680 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.593404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.600425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.601704 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.715948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO dbcounter [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Registered counter for database nova_cell0 Aug 08 02:31:33.723054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_db.sqlalchemy.engines [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.730673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writer thread running {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:33.748387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Registered counter for database nova_cell0 Aug 08 02:31:33.755317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:31:33.760041 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:31:34.055750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: WARNING keystonemiddleware.auth_token [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:31:34.063353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: WARNING keystonemiddleware.auth_token [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:31:34.080219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:31:34.087602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:31:34.406292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: WARNING keystonemiddleware.auth_token [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:31:34.412352 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: WARNING keystonemiddleware.auth_token [None req-861bbf17-3418-4e2e-93c6-8d6d16d8dfd4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:31:34.418680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561074cc49c0 pid: 124658 (default app) Aug 08 02:31:34.431724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:31:34.437828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-4c994469-31d3-496a-a48a-dbdf042122b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:31:34.444189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561074cc49c0 pid: 124659 (default app) Aug 08 02:32:11.296402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:11.298583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:11.299979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:11.301051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:12.446707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5f2a5aa4-dbc3-48ce-90e1-1013651c03d3 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Action: 'create', calling method: .version_select at 0x7fb2bc1fbdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1214005941", "metadata": {"Type": "work"}}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:15.179618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5f2a5aa4-dbc3-48ce-90e1-1013651c03d3 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.652483 Aug 08 02:32:15.179618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 02:32:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3655 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 02:32:15.341689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f042117d-927f-4ac8-b9b7-b44ba4e51c78 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Calling method '.version_select at 0x7fb2bc2d4940>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:15.409549 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.410388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.411194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.412199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.832747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bb81bf8c-8dd0-45ef-9711-ef09d78e3eea tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc0ecc10>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:16.150305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f042117d-927f-4ac8-b9b7-b44ba4e51c78 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a" status: 200 len: 354 microversion: 2.1 time: 1.198240 Aug 08 02:32:16.150973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:14 2022] GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a => generated 354 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:16.170872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1daa566f-9796-4af0-8fe5-92885bbd6c73 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Calling method '.version_select at 0x7fb2bc126e50>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:16.416991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bb81bf8c-8dd0-45ef-9711-ef09d78e3eea tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bf26a711-c50b-428f-ba47-646a766e0ba2" status: 200 len: 351 microversion: 2.1 time: 0.588626 Aug 08 02:32:16.418461 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:15 2022] GET /compute/v2.1/os-volumes/bf26a711-c50b-428f-ba47-646a766e0ba2 => generated 351 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:32:16.471448 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1daa566f-9796-4af0-8fe5-92885bbd6c73 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a" status: 200 len: 354 microversion: 2.1 time: 0.311354 Aug 08 02:32:16.472992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:16 2022] GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a => generated 354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:16.494282 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-79bbd56a-3635-47b0-a80b-28e994ec5786 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Calling method '.version_select at 0x7fb2bc08d3a0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:16.746889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-79bbd56a-3635-47b0-a80b-28e994ec5786 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a" status: 202 len: 0 microversion: 2.1 time: 0.256803 Aug 08 02:32:16.750772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:32:16 2022] DELETE /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:32:16.756680 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1ee3ad19-c5f4-41ac-8409-0f44fc1c5083 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Calling method '.version_select at 0x7fb2bc0723a0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:16.995957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1ee3ad19-c5f4-41ac-8409-0f44fc1c5083 tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a" status: 200 len: 353 microversion: 2.1 time: 0.243444 Aug 08 02:32:16.996874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:16 2022] GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:18.013917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0b517527-7dfc-48b9-a60e-057d5abb5b0c tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Calling method '.version_select at 0x7fb2bc08da60>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:18.399382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-0b517527-7dfc-48b9-a60e-057d5abb5b0c tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] HTTP exception thrown: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0b517527-7dfc-48b9-a60e-057d5abb5b0c tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Request method failure captured: Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a HTTP/1.1 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HWrSoLEKBohXLe0GtOGFtYJywtVAI59AiNWzDKY_BSxUBjny2nmJ62CCWgSPSgojFHGXY10XQ2ItQC5fs4fbM38a-vR-xRS2Fbe_UC1jNwOcoU5b1P-Mhabzs23oicSBrPoQT1QaJD0YmMukMtiaVjspXUih45kEinSQF8-tVQbYW8 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: b86941379d2b4d7f81e0dd09a0494692 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-VolumesGetTestJSON-1894537721 Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:32:18.404343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b86941379d2b4d7f81e0dd09a0494692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b86941379d2b4d7f81e0dd09a0494692"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b86941379d2b4d7f81e0dd09a0494692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b86941379d2b4d7f81e0dd09a0494692"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-VolumesGetTestJSON-1894537721 Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: b86941379d2b4d7f81e0dd09a0494692 Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-VolumesGetTestJSON-1894537721 Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-VolumesGetTestJSON-1894537721-project Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: b532fee72b104c8094a63a738a37bf09 Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-VolumesGetTestJSON-1894537721-project Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'f3462c60-f30c-472f-bdcf-4ad891e14f0a'} Aug 08 02:32:18.428519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. (HTTP 404) (Request-ID: req-38034601-69b9-4053-afab-785dc7e3fe11) Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:18.432637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:32:18.435232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:32:18.439101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0b517527-7dfc-48b9-a60e-057d5abb5b0c tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] Returning 404 to user: Volume f3462c60-f30c-472f-bdcf-4ad891e14f0a could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0b517527-7dfc-48b9-a60e-057d5abb5b0c tempest-VolumesGetTestJSON-1894537721 tempest-VolumesGetTestJSON-1894537721-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a" status: 404 len: 109 microversion: 2.1 time: 0.400770 Aug 08 02:32:18.448483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:18 2022] GET /compute/v2.1/os-volumes/f3462c60-f30c-472f-bdcf-4ad891e14f0a => generated 109 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:19.442702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8287f2e7-1814-492e-beb0-c5ddc3a48b0f tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc072a60>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:19.541535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8287f2e7-1814-492e-beb0-c5ddc3a48b0f tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/81751c09-8ed9-4aa7-a3fd-824bbc189eeb" status: 200 len: 350 microversion: 2.1 time: 0.102370 Aug 08 02:32:19.542585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:19 2022] GET /compute/v2.1/os-volumes/81751c09-8ed9-4aa7-a3fd-824bbc189eeb => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:21.713285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6c50c2da-3b42-4cc4-b69c-9f52f96c3eb6 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc07b1f0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.788738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5d6aa535-63a6-4732-bda9-b97705cefdab tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'create', calling method: .version_select at 0x7fb2bbff63a0>, body: {"keypair": {"name": "tempest-keypair-2000284397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrFlYx1F+pFF6L2kWrVrILZMqHNslhZSJa/k01cYD6NFdSCPF0mowMlTfPd29l+PPUU4eN0vLvPhFIqBkfp9mP7lLjLsuUlpEqFkXLw+GhUX5+5M2EhPwOEI/t6Ku9Rog=="}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:21.833756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6c50c2da-3b42-4cc4-b69c-9f52f96c3eb6 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/85ced5eb-df5a-4b0e-af5b-dbe397a532ea" status: 200 len: 351 microversion: 2.1 time: 0.125494 Aug 08 02:32:21.834905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:21 2022] GET /compute/v2.1/os-volumes/85ced5eb-df5a-4b0e-af5b-dbe397a532ea => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:21.847539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c682862e-df82-4fd2-b796-4941ee0edf06 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc126f70>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.927156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-5d6aa535-63a6-4732-bda9-b97705cefdab tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'key_pairs'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:21.937926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-5d6aa535-63a6-4732-bda9-b97705cefdab tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for user 7fd9eb21aa634650a7022b7b4ca145fd and project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'key_pairs'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:22.059442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c682862e-df82-4fd2-b796-4941ee0edf06 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.215124 Aug 08 02:32:22.061283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Aug 8 02:32:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:22.076980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7a33796c-a90f-408c-9692-c5de82e5a53f tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc126dc0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:22.132622 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5d6aa535-63a6-4732-bda9-b97705cefdab tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.638841 Aug 08 02:32:22.133876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 5/11] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Aug 8 02:32:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 641 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 02:32:22.279712 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7a33796c-a90f-408c-9692-c5de82e5a53f tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.207664 Aug 08 02:32:22.280498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1149 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:32:22.295464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1959a6f6-7542-4d63-8708-cebc082fc4f4 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bbfc3a60>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:22.513808 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1959a6f6-7542-4d63-8708-cebc082fc4f4 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223068 Aug 08 02:32:22.514674 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:22.528100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-914514e4-fc1f-4bd5-a591-30ad6ae5ccbb tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc07bf70>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:22.626646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-914514e4-fc1f-4bd5-a591-30ad6ae5ccbb tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102921 Aug 08 02:32:22.627867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1167 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:22.644109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7c662114-6f91-4cb7-b633-01e3ba0e1504 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bb782310>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:22.777505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7c662114-6f91-4cb7-b633-01e3ba0e1504 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138994 Aug 08 02:32:22.778179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1170 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:22.796294 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-391dbc08-e8b1-41f7-a939-1492a37b44eb tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc07b160>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:22.947811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-391dbc08-e8b1-41f7-a939-1492a37b44eb tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.159050 Aug 08 02:32:22.948399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:22.964894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a5cb7641-93ea-4bd1-a949-d615554827bd tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bb782b80>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:23.144805 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a5cb7641-93ea-4bd1-a949-d615554827bd tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.187084 Aug 08 02:32:23.147457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1188 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:23.160999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-192bdbd1-e2fc-46f0-95c5-1111fcf063e3 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] Calling method '.version_select at 0x7fb2bc08de50>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:23.436284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-192bdbd1-e2fc-46f0-95c5-1111fcf063e3 tempest-VolumesTestJSON-62633865 tempest-VolumesTestJSON-62633865-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.279255 Aug 08 02:32:23.436934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Aug 8 02:32:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:25.213506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1977706751", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:25.248285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1613090836", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "networks": [{"uuid": "ebd23614-7412-4d82-9d70-8d1b57406fcb"}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:25.438400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] validate_networks() for [('a983a294-01dc-46eb-aef5-c79712b4e933', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:32:25.494522 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] validate_networks() for [('ebd23614-7412-4d82-9d70-8d1b57406fcb', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:32:27.006561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:32:27.006981 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:32:27.007353 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:32:27.007802 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:32:27.008233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:32:27.064216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:27.064715 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:27.070991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:27.078835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:27.079484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:27.079940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:27.151586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for project f1f194384993444da5c7b7f30e42746d. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:27.158770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for user f6fb96d9442147e0a2201fe890d6f955 and project f1f194384993444da5c7b7f30e42746d. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:27.174194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:32:27.184334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:32:27.418090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-02b5da48-189d-4e64-ae8e-57d0404c5a52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.590600 Aug 08 02:32:27.425702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 11/19] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:32:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:32:27.433283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1483813803", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87360f95-f3ba-477f-b837-ec26e9e98a48"}], "security_groups": [{"name": "tempest-securitygroup--1120737452"}], "key_name": "tempest-keypair-2000284397", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:27.490250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:32:27.506310 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:32:27.514825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:32:27.514825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:32:27.514825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:32:27.556470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:27.561177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:27.561900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:27.565920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:27.566658 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:27.569826 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:27.654166 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Getting quotas for project ce575522168344caacf13cfc7779e25b. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:27.670328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Getting quotas for user d725e4cb658b43438c1f22a80b1dc5ad and project ce575522168344caacf13cfc7779e25b. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:27.713457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:32:27.718401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:32:27.831771 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] validate_networks() for [('87360f95-f3ba-477f-b837-ec26e9e98a48', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:32:27.967931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f29b4671-82f1-45ce-bd65-3ac7af71ff42 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.197867 Aug 08 02:32:27.979484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 9/20] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:32:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:32:27.993520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9d31b535-47c0-4760-b715-4493edbd4d71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:27.994484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9d31b535-47c0-4760-b715-4493edbd4d71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:28.340606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9d31b535-47c0-4760-b715-4493edbd4d71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:28.389626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9d31b535-47c0-4760-b715-4493edbd4d71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1222 microversion: 2.1 time: 0.406399 Aug 08 02:32:28.392957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 10/21] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:27 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1222 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:28.414886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f9b5e43f-27f2-4154-bb43-e4ae26266484 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:28.415657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f9b5e43f-27f2-4154-bb43-e4ae26266484 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:28.528896 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f9b5e43f-27f2-4154-bb43-e4ae26266484 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:28.539579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f9b5e43f-27f2-4154-bb43-e4ae26266484 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1215 microversion: 2.1 time: 0.143295 Aug 08 02:32:28.554277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 11/22] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:28 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:28.616718 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2029877000", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:28.699602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] validate_networks() for [('a983a294-01dc-46eb-aef5-c79712b4e933', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:32:28.742825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:32:28.743812 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:32:28.744296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:32:28.745312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:32:28.745738 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:32:28.755638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.756124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.756576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.757405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.757944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.758398 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.776247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:28.780915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for user 7fd9eb21aa634650a7022b7b4ca145fd and project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:28.797050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:32:28.797661 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:32:28.992881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-293367b4-d263-46ae-96c8-206cd7f9f927 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.562685 Aug 08 02:32:28.993943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 12/23] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Aug 8 02:32:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 02:32:29.016828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-19d989d2-a368-4667-8955-0224fce8861f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:29.022547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-19d989d2-a368-4667-8955-0224fce8861f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:29.175034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19d989d2-a368-4667-8955-0224fce8861f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:29.193075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19d989d2-a368-4667-8955-0224fce8861f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:29.197881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19d989d2-a368-4667-8955-0224fce8861f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:29.199764 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-19d989d2-a368-4667-8955-0224fce8861f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1282 microversion: 2.20 time: 0.196585 Aug 08 02:32:29.200863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 13/24] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:29 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:29.380349 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:32:29.381460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:32:29.383328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:32:29.383905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:32:29.384837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:32:29.401076 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:29.401935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:29.402396 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:29.404016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:29.404657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:29.409196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:29.426741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for project f1f194384993444da5c7b7f30e42746d. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:29.433861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for user f6fb96d9442147e0a2201fe890d6f955 and project f1f194384993444da5c7b7f30e42746d. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:29.448464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:32:29.451183 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:32:29.563192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d19cb1eb-dfa2-43c0-b902-795ff143d729 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:29.563820 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d19cb1eb-dfa2-43c0-b902-795ff143d729 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:29.626280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-362756a8-589c-4e96-a06e-dce937ccf1b3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.016035 Aug 08 02:32:29.626963 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 12/25] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:32:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 02:32:29.667331 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2d60c8ea-a7d6-41db-b928-68438a708ffb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:29.676575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2d60c8ea-a7d6-41db-b928-68438a708ffb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:29.718519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d19cb1eb-dfa2-43c0-b902-795ff143d729 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:29.730125 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d19cb1eb-dfa2-43c0-b902-795ff143d729 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1215 microversion: 2.1 time: 0.169550 Aug 08 02:32:29.730831 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 14/26] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:29 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:29.816621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2d60c8ea-a7d6-41db-b928-68438a708ffb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:29.848071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2d60c8ea-a7d6-41db-b928-68438a708ffb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1222 microversion: 2.1 time: 0.205298 Aug 08 02:32:29.848722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:29 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:30.226061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ed250c66-95f6-472f-b93b-520fdd6b9e27 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:30.227227 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ed250c66-95f6-472f-b93b-520fdd6b9e27 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:30.301345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed250c66-95f6-472f-b93b-520fdd6b9e27 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:30.311171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed250c66-95f6-472f-b93b-520fdd6b9e27 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:30.312679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed250c66-95f6-472f-b93b-520fdd6b9e27 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:30.313779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ed250c66-95f6-472f-b93b-520fdd6b9e27 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1282 microversion: 2.20 time: 0.092801 Aug 08 02:32:30.337606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 15/28] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:30 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:30.753306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b66be881-55a4-4a16-9ea6-45299e74be23 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:30.754618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b66be881-55a4-4a16-9ea6-45299e74be23 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:30.860969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b66be881-55a4-4a16-9ea6-45299e74be23 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:30.869333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-abb8d97a-2aae-4d4f-ae5d-ba58e28b4cee tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:30.869954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-abb8d97a-2aae-4d4f-ae5d-ba58e28b4cee tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:30.887233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b66be881-55a4-4a16-9ea6-45299e74be23 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1215 microversion: 2.1 time: 0.138461 Aug 08 02:32:30.891766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:30 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:31.039062 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-abb8d97a-2aae-4d4f-ae5d-ba58e28b4cee tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:31.046578 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-abb8d97a-2aae-4d4f-ae5d-ba58e28b4cee tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1222 microversion: 2.1 time: 0.181410 Aug 08 02:32:31.048064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 16/30] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:30 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:31.348449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:31.351690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:31.384564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.385107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.385560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.389556 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.390059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.395071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.614204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:31.627905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:31.629462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:31.630609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-784dfb25-35b0-4ab8-8b2c-6145bbb949db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1286 microversion: 2.20 time: 0.294599 Aug 08 02:32:31.631610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 15/31] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:31 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1286 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:31.920658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:31.921281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:31.928669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.929677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.930287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.931044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.931491 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.932080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:32.076207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:32.077068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:32.093844 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:32.095024 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:32.096740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:32.098032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:32.099302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:32.102472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:32.109768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:32.126509 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1529c071-3f65-48e1-939e-247cf2d134f3 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1219 microversion: 2.1 time: 0.218478 Aug 08 02:32:32.127583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:31 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:32.223980 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:32.232945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1df0f377-a0dd-4e44-a94a-5ce092d88060 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1226 microversion: 2.1 time: 0.164845 Aug 08 02:32:32.233636 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 16/33] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:32 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1226 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:32.658524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:32.659410 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:32.669460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:32.672759 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:32.673531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:32.674393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:32.674991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:32.675552 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:32.953098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:32.985273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:32.995884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:32.995884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-321f10ee-9ea2-4185-ad90-eea21156d225 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1334 microversion: 2.20 time: 0.343554 Aug 08 02:32:32.996675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 18/34] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:32 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1334 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:33.152837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:33.153546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:33.170462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.172027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.173707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.174672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.175313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.175947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.260742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:33.261421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:33.272128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.272624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.275301 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.277234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.278832 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.279557 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.300861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:33.313207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bca5973c-46e6-422f-a72a-7b2e92151889 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1267 microversion: 2.1 time: 0.163961 Aug 08 02:32:33.317312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:33 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:33.354001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:33.361406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-71f88434-5053-4375-9f78-80be29197da8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1274 microversion: 2.1 time: 0.109422 Aug 08 02:32:33.361970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 19/36] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:33 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:34.026694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:34.027375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:34.042036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:34.045142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:34.046902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:34.048886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:34.052955 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:34.059149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:34.342079 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:34.345735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:34.364425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:34.368799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:34.394580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:34.400929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:34.401380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:34.407139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:34.545129 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:34.549992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:34.561174 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:34.563366 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:34.564171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ac451748-b550-4051-8a8b-5a4f5e4891f1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1275 microversion: 2.1 time: 0.230145 Aug 08 02:32:34.565221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 20/37] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:34 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:34.572145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:34.573209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:34.593561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dacd9756-064a-48f1-82fb-2a0f83ff9bb6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1340 microversion: 2.20 time: 0.542710 Aug 08 02:32:34.595388 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 18/38] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:34 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1340 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:34.596630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:34.597339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:34.598689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:34.602702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:34.603353 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:34.603974 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:34.811403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:34.837596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-959a8279-0d21-43fe-ba8d-acdca904adfc tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1280 microversion: 2.1 time: 0.268611 Aug 08 02:32:34.840008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:34 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1280 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:35.589033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:35.589688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:35.603641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.605191 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.609235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.610406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.611164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.611842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.631361 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c6cc433f-d3ed-43ee-8eb2-c47baa41c268 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Action: 'create', calling method: .version_select at 0x7fb2ba61af70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1694900218", "metadata": {"Type": "work"}}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c6cc433f-d3ed-43ee-8eb2-c47baa41c268 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Request method failure captured: Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 122 Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HXDICWRf78ny7d0jcJh8NSleJegZchv9J5EaXFhX5cyVNB9tFQVB66CXF8qd0CmCgyFgZ-xoYXxVAjD8e7FrWgT_5kjQmszbd6q1idRulU6OJmtW67P3SGqGoCfajDTatU6cFdc-8Bz89J9-FSAncS2ngYXFraKZFYoo9MzSXfjO6Y Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:32:35.651440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 06717ab36e1c4265beab5e6213f37eb3 Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1694900218", "metadata": {"Type": "work"}}} Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: Aug 08 02:32:35.653750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1694900218', 'metadata': {'Type': 'work'}}}} Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise error Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:35.654683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 02:32:35.656041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 02:32:35.658073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 02:32:35.658073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.658073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c6cc433f-d3ed-43ee-8eb2-c47baa41c268 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:35.665487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c6cc433f-d3ed-43ee-8eb2-c47baa41c268 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.302115 Aug 08 02:32:35.670210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 19/40] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 02:32:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:32:35.691426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:35.696540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:35.705892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.706787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.707430 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.708354 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.709014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.709682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.748454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:35.760668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-63d4d62c-02f2-4391-8abd-bf97231c3bc6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1273 microversion: 2.1 time: 0.175506 Aug 08 02:32:35.774006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 22/41] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:35 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:35.779633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d3f7dc1-817d-4324-aa48-5dc2d5f89102 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Action: 'create', calling method: .version_select at 0x7fb2bae39790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1380815788", "metadata": {"Type": "work"}}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d3f7dc1-817d-4324-aa48-5dc2d5f89102 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Request method failure captured: Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 120 Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HXDICWRf78ny7d0jcJh8NSleJegZchv9J5EaXFhX5cyVNB9tFQVB66CXF8qd0CmCgyFgZ-xoYXxVAjD8e7FrWgT_5kjQmszbd6q1idRulU6OJmtW67P3SGqGoCfajDTatU6cFdc-8Bz89J9-FSAncS2ngYXFraKZFYoo9MzSXfjO6Y Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:32:35.785213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 06717ab36e1c4265beab5e6213f37eb3 Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1380815788", "metadata": {"Type": "work"}}} Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:32:35.786481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1380815788', 'metadata': {'Type': 'work'}}}} Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise error Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi '0' Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:35.787219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 02:32:35.788782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 02:32:35.789893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 02:32:35.789893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.791601 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d3f7dc1-817d-4324-aa48-5dc2d5f89102 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:35.794250 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2d3f7dc1-817d-4324-aa48-5dc2d5f89102 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018813 Aug 08 02:32:35.795110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 23/42] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 02:32:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:32:35.806218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ff4ff76-01bc-403a-928a-f0f4373c78e0 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Action: 'create', calling method: .version_select at 0x7fb2bae935e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-951680129", "metadata": {"Type": "work"}}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ff4ff76-01bc-403a-928a-f0f4373c78e0 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Request method failure captured: Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 118 Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HXDICWRf78ny7d0jcJh8NSleJegZchv9J5EaXFhX5cyVNB9tFQVB66CXF8qd0CmCgyFgZ-xoYXxVAjD8e7FrWgT_5kjQmszbd6q1idRulU6OJmtW67P3SGqGoCfajDTatU6cFdc-8Bz89J9-FSAncS2ngYXFraKZFYoo9MzSXfjO6Y Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:32:35.810922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 06717ab36e1c4265beab5e6213f37eb3 Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-951680129", "metadata": {"Type": "work"}}} Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:32:35.815733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-951680129', 'metadata': {'Type': 'work'}}}} Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise error Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi '' Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:35.816378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 02:32:35.817412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 02:32:35.820574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 02:32:35.820574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.820574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ff4ff76-01bc-403a-928a-f0f4373c78e0 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:35.820574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ff4ff76-01bc-403a-928a-f0f4373c78e0 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012414 Aug 08 02:32:35.821945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 24/43] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 02:32:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:32:35.828066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a5a100dc-9785-451d-aa8e-15251e0a80c3 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Calling method '.version_select at 0x7fb2bca48f70>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:35.881706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-a5a100dc-9785-451d-aa8e-15251e0a80c3 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] HTTP exception thrown: Volume tempest-invalid-1168946908 could not be found. Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a5a100dc-9785-451d-aa8e-15251e0a80c3 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Request method failure captured: Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1168946908 HTTP/1.1 Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HXDICWRf78ny7d0jcJh8NSleJegZchv9J5EaXFhX5cyVNB9tFQVB66CXF8qd0CmCgyFgZ-xoYXxVAjD8e7FrWgT_5kjQmszbd6q1idRulU6OJmtW67P3SGqGoCfajDTatU6cFdc-8Bz89J9-FSAncS2ngYXFraKZFYoo9MzSXfjO6Y Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:32:35.897100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 06717ab36e1c4265beab5e6213f37eb3 Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Volume tempest-invalid-1168946908 could not be found. Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'tempest-invalid-1168946908'} Aug 08 02:32:35.899207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1168946908 could not be found. (HTTP 404) (Request-ID: req-4dc5ac79-b583-4cf1-a573-73587828244b) Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.900918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:32:35.903674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1168946908 could not be found. Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:32:35.908117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1168946908 could not be found. Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1168946908 could not be found. Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a5a100dc-9785-451d-aa8e-15251e0a80c3 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Returning 404 to user: Volume tempest-invalid-1168946908 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a5a100dc-9785-451d-aa8e-15251e0a80c3 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1168946908" status: 404 len: 99 microversion: 2.1 time: 0.086072 Aug 08 02:32:35.910648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 25/44] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 02:32:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1168946908 => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 02:32:35.942748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:35.942748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:35.967928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.968477 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.968930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.971530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.971530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.971530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.158147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:36.176847 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2562f402-5cda-4566-8c65-379fe04b1506 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1280 microversion: 2.1 time: 0.252114 Aug 08 02:32:36.177703 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 26/45] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:35 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:36.194310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-761470bb-a4d5-4659-8bc1-416f13125c6b tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013031 Aug 08 02:32:36.197267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 27/46] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Aug 8 02:32:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 02:32:36.206502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3e7bfd13-49ca-40d6-a735-e4d40ccb6db9 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003820 Aug 08 02:32:36.207893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 28/47] 10.222.0.15 () {58 vars in 1137 bytes} [Mon Aug 8 02:32:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 08 02:32:36.225320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9b8dfa7-9afc-473f-9080-aa06c8369a3e tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Calling method '.version_select at 0x7fb2bae89310>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:36.384717 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-f9b8dfa7-9afc-473f-9080-aa06c8369a3e tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] HTTP exception thrown: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9b8dfa7-9afc-473f-9080-aa06c8369a3e tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Request method failure captured: Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/os-volumes/58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 HTTP/1.1 Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HXDICWRf78ny7d0jcJh8NSleJegZchv9J5EaXFhX5cyVNB9tFQVB66CXF8qd0CmCgyFgZ-xoYXxVAjD8e7FrWgT_5kjQmszbd6q1idRulU6OJmtW67P3SGqGoCfajDTatU6cFdc-8Bz89J9-FSAncS2ngYXFraKZFYoo9MzSXfjO6Y Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:32:36.386940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 06717ab36e1c4265beab5e6213f37eb3 Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '58c03bd0-06b6-47aa-a124-dd4c8b02d4e4'} Aug 08 02:32:36.388220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. (HTTP 404) (Request-ID: req-f6b70093-ebd7-4cf2-b04f-f756b7ab41c0) Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:36.389006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:32:36.390466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 02:32:36.391445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9b8dfa7-9afc-473f-9080-aa06c8369a3e tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Returning 404 to user: Volume 58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f9b8dfa7-9afc-473f-9080-aa06c8369a3e tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/58c03bd0-06b6-47aa-a124-dd4c8b02d4e4" status: 404 len: 109 microversion: 2.1 time: 0.174393 Aug 08 02:32:36.392421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 29/48] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:32:36 2022] DELETE /compute/v2.1/os-volumes/58c03bd0-06b6-47aa-a124-dd4c8b02d4e4 => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:36.404884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-54694153-1693-40e3-876f-016a804b4c23 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Calling method '.version_select at 0x7fb2bae5d700>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:36.611068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-54694153-1693-40e3-876f-016a804b4c23 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] HTTP exception thrown: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-54694153-1693-40e3-876f-016a804b4c23 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Request method failure captured: Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-volumes/99167209-1a9e-43c6-9254-8c2ddc4249be HTTP/1.1 Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HXDICWRf78ny7d0jcJh8NSleJegZchv9J5EaXFhX5cyVNB9tFQVB66CXF8qd0CmCgyFgZ-xoYXxVAjD8e7FrWgT_5kjQmszbd6q1idRulU6OJmtW67P3SGqGoCfajDTatU6cFdc-8Bz89J9-FSAncS2ngYXFraKZFYoo9MzSXfjO6Y Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:32:36.614476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94cdabae2f2f4114b107d1ef4c49ba7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 94cdabae2f2f4114b107d1ef4c49ba7a Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-1511759164 Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 06717ab36e1c4265beab5e6213f37eb3 Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-1511759164-project Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '99167209-1a9e-43c6-9254-8c2ddc4249be'} Aug 08 02:32:36.615551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. (HTTP 404) (Request-ID: req-93eb988c-4b7f-4240-b162-52f1e6976e8b) Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:36.616226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:32:36.618489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:32:36.620111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. Aug 08 02:32:36.621583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:32:36.624650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-54694153-1693-40e3-876f-016a804b4c23 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] Returning 404 to user: Volume 99167209-1a9e-43c6-9254-8c2ddc4249be could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:36.626051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-54694153-1693-40e3-876f-016a804b4c23 tempest-VolumesNegativeTest-1511759164 tempest-VolumesNegativeTest-1511759164-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/99167209-1a9e-43c6-9254-8c2ddc4249be" status: 404 len: 109 microversion: 2.1 time: 0.231134 Aug 08 02:32:36.627124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 30/49] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:32:36 2022] GET /compute/v2.1/os-volumes/99167209-1a9e-43c6-9254-8c2ddc4249be => generated 109 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:32:36.783160 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:36.784071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:36.798422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.799183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.801212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.804999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.805706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.808280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:37.113194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:37.127307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:37.130075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:37.131968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ad9ff9eb-7537-451d-a439-40eb36468b3b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 1.460022 Aug 08 02:32:37.151315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:37.151564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 20/50] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:35 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:37.175467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-156a7db4-041f-4ea0-8f44-35d9ff717db1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1273 microversion: 2.1 time: 0.394552 Aug 08 02:32:37.188735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 31/51] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:36 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:37.416571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:37.416571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:37.416571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:37.416571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:37.416990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:37.416990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:37.416990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:37.416990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:37.417248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:37.417248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d1480232-06a1-4c07-99af-152ceac6ac5b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1280 microversion: 2.1 time: 0.121568 Aug 08 02:32:37.417248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 21/52] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:37 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:38.164035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:38.164633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:38.175310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.175937 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.197212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.198262 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.198882 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.199398 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.431054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:38.431681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:38.444031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.445569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.446033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.449261 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.451837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.453071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.730878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:38.754409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:38.761005 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:38.764514 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3e5ce8da-8645-46a8-9136-f48107c9a3f4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.603796 Aug 08 02:32:38.766504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 32/53] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:38 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:38.771945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:38.773435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:38.781020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:38.794163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.795051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.795847 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.796995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.797720 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.798431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.384941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:39.393207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e2ca7733-f828-4742-a508-6e77f5b42f4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.965912 Aug 08 02:32:39.410662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 22/54] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:38 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:39.425135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=4 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:39.556748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:39.571651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.577313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.577313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.587267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:39.606947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b9b8672d-935a-4db4-a55a-a20728ef70b8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.839008 Aug 08 02:32:39.619164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 33/55] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:38 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:39.642598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Creating event network-changed:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:32:39.644711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 02:32:39.645386 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a1e4e0bd-c8a4-4dc8-bb21-8bbb03f1574c req-404497e4-5d35-4e85-8f36-dc96b26298fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=124658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 02:32:39.646704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.678711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.680139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.682057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.683135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.684326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.708132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.compute.rpcapi [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 02:32:39.712746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] Releasing lock "compute-rpcapi-router" {{(pid=124658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 02:32:39.767539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1b61a174-e10c-4511-bcaa-7dba25b25640 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353754 Aug 08 02:32:39.773267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 23/56] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:39.793371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:39.794290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:39.802320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.803113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.803687 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.804641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.805050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.805470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:40.307681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:40.310314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:40.313317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:40.315354 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3d9e8d40-55b6-445a-872d-0dc5f2e841ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.529376 Aug 08 02:32:40.363673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 34/57] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:39 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:40.426759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:40.427682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:40.455257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:40.462763 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:40.466178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:40.472218 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:40.474342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:40.479572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:40.641319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:40.644789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:40.656866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:40.658186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:40.659374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:40.660416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:40.661128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:40.665379 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:40.886246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=24 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:41.044055 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=20 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:41.196532 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:41.214824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dafa3ab0-aca3-4b78-9f42-e65243882bd4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.569967 Aug 08 02:32:41.214824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 35/58] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:40 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:41.377885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:41.378678 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:41.383589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:41.402075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8f2fc36f-b0c7-456b-80c5-d5bb2170987c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.985961 Aug 08 02:32:41.405980 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 24/59] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:40 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:41.413858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:41.413858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:41.413858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:41.413858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:41.437551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:41.438958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:41.790621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:41.858650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:41.870176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:41.884943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-92c07ca3-5007-48fc-9055-10b1eb8430a3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.511734 Aug 08 02:32:41.889839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 36/60] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:41 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:42.235915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:42.236789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:42.244915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.245402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.245828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.247537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.247984 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.248458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.533082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4449d47c-fbac-4e23-8017-0a283a5ba7d9", "tag": "b02fabe8-9ace-422a-a568-18c37daa63c2"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:42.567337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.568108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.576134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.604266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Creating event network-changed:b02fabe8-9ace-422a-a568-18c37daa63c2 for instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 on hv-cinder-85226 Aug 08 02:32:42.605019 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 02:32:42.605602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-12b8e213-dae8-4c0e-9847-6560ce4c3221 req-921b2384-ee55-466a-a634-9752a2cc2c99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 02:32:42.606700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.607117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.607751 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.608506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.608921 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.609637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.620608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.compute.rpcapi [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 02:32:42.621506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] Releasing lock "compute-rpcapi-router" {{(pid=124659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 02:32:42.666462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0b64dccd-3959-4fc3-919b-f020c686f678 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.418278 Aug 08 02:32:42.667606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 37/61] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:32:42.672992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:42.676889 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:42.681588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.682176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.682679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.683453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.684012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.684512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.892087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:42.913657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-081024ef-6c5c-4dbf-89e2-6495c582fe1b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.240406 Aug 08 02:32:42.923669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 38/62] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:42 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:42.941733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:42.945637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:42.961343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.961848 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.962293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.963044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.963499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.963929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.967947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:42.979774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-693f79bf-18c2-48c9-bef0-66ab97c45d84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.749375 Aug 08 02:32:42.981647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 25/63] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:42 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:43.196645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:43.211602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:43.213575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:43.217204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bd3215f3-3776-4960-8c6e-39f072523520 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.296084 Aug 08 02:32:43.219360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 39/64] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:42 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:43.936282 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:43.936888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:43.946534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:43.948435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:43.950245 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:43.954101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:43.954101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:43.954269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.000850 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:44.001462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:44.009616 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.011643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.011643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.011643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.011643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.012065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.020607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:44.292081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:44.299852 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0343726d-6e5e-4207-8335-c5c0f9febdb1 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.302622 Aug 08 02:32:44.300910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 40/65] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:43 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:44.306610 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:44.307394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:44.329835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.330612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.331190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.332029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.332622 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.333190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.410784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:44.421009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8e9e1f7d-9a32-4648-8912-7bd65d7c7a3e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.489041 Aug 08 02:32:44.421424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 26/66] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:43 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:44.629867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:44.642562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:44.643862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:44.645296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7bb71305-9e1c-4646-babc-90f852152109 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.343302 Aug 08 02:32:44.665777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 41/67] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:44 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:44.789351 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf3b2b7-8778-4f17-b615-2dad95f66ecb", "tag": "75f505e8-1b29-4894-a1e1-92ef1e0c2996"}, {"name": "network-changed", "server_uuid": "b383010a-a42d-40bb-87aa-88500e694738", "tag": "b09b9826-f63f-4724-9a75-a75195d2391a"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:44.805400 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.805885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.806302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.863812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] Creating event network-changed:75f505e8-1b29-4894-a1e1-92ef1e0c2996 for instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb on hv-cinder-85226 Aug 08 02:32:44.864562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] Creating event network-changed:b09b9826-f63f-4724-9a75-a75195d2391a for instance b383010a-a42d-40bb-87aa-88500e694738 on hv-cinder-85226 Aug 08 02:32:44.880737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-fac7cc1a-62a0-4128-8161-10d9cab2e129 req-8acaf269-69b9-4314-9cd7-bf2614a7e73c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094259 Aug 08 02:32:44.883668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 27/68] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:45.326906 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:45.328218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:45.336702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.337435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.337866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.342142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.342142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.342142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.448249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:45.449696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:45.477045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.477547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.477988 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.484749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.485234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.485773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.647150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:45.656353 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-67a9fe0a-4388-419d-ae9c-c41f16540ad7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.334769 Aug 08 02:32:45.657235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 42/69] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:45 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:45.675007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:45.675841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:45.683481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.684154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.684724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.685725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.686310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.686954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.928032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:45.937883 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:45.939822 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:45.941156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b166cf99-1f61-41d4-9dcf-c17fff0d7b34 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.274183 Aug 08 02:32:45.968864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 43/70] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:45 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:46.079626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:46.091176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8c3e60d1-434f-41d6-9646-da7324cf5838 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.651161 Aug 08 02:32:46.113158 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 28/71] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:45 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:46.685990 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:46.688644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:46.690562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:46.695651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:46.696140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:46.696585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:46.697296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:46.697754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:46.698177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:46.860057 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:46.864281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-37808e53-6e63-47a9-90f6-4c45f008e420 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.183065 Aug 08 02:32:46.870389 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 44/72] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:46 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:46.966850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:46.968486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:46.975344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:46.989251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:46.989251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:46.989251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:46.989251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:46.989829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:47.121675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:47.124027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:47.139275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:47.140322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:47.141020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:47.142124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:47.143240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:47.145387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:47.197192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:47.206727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:47.208573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:47.210613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-794cdd02-9dc4-4800-b155-00607c8e5868 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.246925 Aug 08 02:32:47.211669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 29/73] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:46 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:47.327237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:47.335393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8e751b3d-984f-407a-a4d1-18a3c1e1675d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.225118 Aug 08 02:32:47.335967 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 45/74] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:47 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:47.891089 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:47.891855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:47.898846 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:47.899327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:47.899759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:47.900450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:47.900934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:47.901408 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.060311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:48.067920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ddd78eb5-b3bb-4e82-96d0-fa219ad9e4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.186554 Aug 08 02:32:48.068515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 30/75] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:47 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:48.233717 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:48.234309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:48.240380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:48.240913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:48.241532 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.242221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:48.242705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:48.243132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.358044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:48.360138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:48.366761 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:48.367744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:48.368385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.369364 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:48.369955 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:48.370607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.388303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:48.400449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:48.402698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:48.403887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-916c99f3-bcea-40bf-aa99-85bb20181e54 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.174808 Aug 08 02:32:48.414722 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 46/76] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:48 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:48.534036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:48.541599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-72f7c8df-d1d2-4a12-a5d1-a7e5502bf1ae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.190566 Aug 08 02:32:48.542661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 31/77] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:48 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:49.093287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:49.094028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:49.100575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.105626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.105626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.105626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.105626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.105993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.240022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:49.249993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d05de3e0-069c-4c0d-be1a-673fb9182418 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.160631 Aug 08 02:32:49.250885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 47/78] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:49 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:49.441051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:49.441787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:49.448814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.450465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.450465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.450648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.451083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.451634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.561863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:49.562733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:49.569515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.571652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.572922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.573859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.574319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.574775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.597621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:49.601388 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:49.607552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:49.609323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:49.610452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-29810fc5-554d-419d-b913-74f283f529ff tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.173272 Aug 08 02:32:49.611204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 32/79] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:49 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:49.762866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:49.774431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f1843a07-c307-44f0-b1f2-edbd64082bab tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.215472 Aug 08 02:32:49.775277 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 48/80] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:49 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:50.271643 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:50.272287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:50.274617 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:50.279519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.279999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.280426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.281110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.281559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.281982 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.421787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:50.430299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2afc127c-a8b1-46f4-ad5c-556b250f95e8 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.161556 Aug 08 02:32:50.430299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 33/81] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:50 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:50.633709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:50.635032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:50.640191 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.640663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.641117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.641786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.642231 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.642695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.796865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:50.801825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:50.804357 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.805687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.806091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.806822 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.807278 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.807678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.851954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:50.860958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:50.862595 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:50.863793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b8b4a53c-c11b-4f59-945e-60bf4aa069d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.234744 Aug 08 02:32:50.864635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 49/82] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:50 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:50.986159 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:50.994044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8d5115dc-486d-4eae-b102-4fb301055021 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.202359 Aug 08 02:32:50.994657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 34/83] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:50 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:51.452801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:51.453430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:51.462061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:51.462777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:51.463224 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:51.468584 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:51.470633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:51.475593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:51.609535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:51.616938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bfdfa0c1-b509-48ee-80d6-8cb82db8fb6d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.169285 Aug 08 02:32:51.618050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 50/84] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:51 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:51.892098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:51.892098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:51.892098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:51.893390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:51.893860 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:51.894291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:51.895013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:51.895459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:51.895882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.014104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:52.015375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:52.021431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.022027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.022564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.024982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.025673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.028309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.081343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:52.096165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:52.097566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:52.099410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e1f56145-7164-4a3c-aee7-b22d7214eb35 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.216959 Aug 08 02:32:52.102113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 35/85] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:51 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:52.192911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:52.210331 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-55435917-3a11-43d7-b3af-414923a5efae tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.199184 Aug 08 02:32:52.211422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 51/86] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:52 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:52.639492 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:52.640266 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:52.646904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.647463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.647952 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.649787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.650205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.650655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.826409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:52.843402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d44f62d0-edab-4e9d-9dde-646243e8fcd7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.202383 Aug 08 02:32:52.843402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 36/87] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:52 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:53.123687 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:53.124292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:53.126134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:53.130811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.131315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.131745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:53.132425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.133363 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.134055 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:53.231141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:53.236541 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:53.238002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.238538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.239035 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:53.248484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.248983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.249423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:53.304659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:53.315426 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:53.316928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:53.318045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e0450fe6-c057-47cd-bcae-46cb9907ebfb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.198200 Aug 08 02:32:53.318709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 52/88] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:53 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:53.388892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:53.396529 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3f61f581-8ac0-4b36-aa71-2cba24a42d41 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.169253 Aug 08 02:32:53.397174 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 37/89] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:53 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:53.864975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:53.865675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:53.872528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.873083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.873525 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:53.874220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.874695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.875121 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:54.030565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:54.047168 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-250af5e5-c631-405c-b780-6fabb5366091 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.185847 Aug 08 02:32:54.057378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 53/90] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:53 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:54.342643 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:54.343730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:54.354799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:54.354799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:54.354799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:54.355773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:54.356774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:54.358736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:54.419871 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:54.426321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:54.429174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:54.429891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:54.430551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:54.431635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:54.432221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:54.432780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:54.605199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:54.612819 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-32022b18-e867-44cf-8eee-38426d100b4d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.200315 Aug 08 02:32:54.613388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 54/91] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:54 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:54.631655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:54.640357 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:54.641900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:54.643020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0406c4b0-7a7e-4d96-8dd8-7eec965d1b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.305857 Aug 08 02:32:54.643576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 38/92] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:54 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:32:55.069934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:55.071102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.080623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.081117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.081561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.082262 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.082774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.089004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.224026 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:55.232935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-eae34afe-c1b8-4619-a1c3-4056d8ff8cdf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.166780 Aug 08 02:32:55.234616 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 55/93] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:55 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:55.633489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:55.634099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.640350 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.640830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.641264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.642007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.642483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.642908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.667575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:55.668214 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.675868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.676418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.676896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.677606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.678061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.678516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.779446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:55.788114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8835b5c4-7ef2-451f-92ed-e23373ec9bb1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.158436 Aug 08 02:32:55.798440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 39/94] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:55 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:55.842377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:55.845722 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:55.850961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:55.853042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:55.854147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-07c6476d-f036-4ab9-9c5b-97713f5f4a59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.191298 Aug 08 02:32:55.854734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 56/95] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:55 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:56.254327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:56.255326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:56.262420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.263131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.263827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.264692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.265305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.265882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.407932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:56.415804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-611e1bce-0081-479c-ac30-930dd707d10f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.165499 Aug 08 02:32:56.416418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 40/96] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:56 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:56.809832 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:56.810489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:56.816762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.817246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.817685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.818400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.818860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.819290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.876296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:56.876914 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:56.884887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.885968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.886586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.888518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.889335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.890125 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:57.015890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:57.023903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-910a42d8-49e8-46ba-bcc0-cfcda1c96382 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.217873 Aug 08 02:32:57.037421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 57/97] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:56 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:57.074288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:57.080965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:57.082702 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:57.083857 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-14b7428d-27d1-4e78-ab2b-226c76f1ace3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.211632 Aug 08 02:32:57.084417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 41/98] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:56 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:57.436351 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:57.436968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:57.443199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:57.443670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:57.444103 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:57.445381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:57.450855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:57.450855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:57.593399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:57.602216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ffcb3e89-d733-4745-a8a0-995632dd11fd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.168966 Aug 08 02:32:57.610489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 58/99] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:57 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:58.050106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:58.050830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:58.057685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.058202 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.058666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.059677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.060135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.060567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.109049 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:58.109785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:58.116171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.117289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.117809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.118741 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.119253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.119779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.207916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:58.218073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-16948920-1a09-43b5-b529-202e022770f2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.176187 Aug 08 02:32:58.218834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 42/100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:58 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:58.277378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:58.285201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:58.286649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:58.287747 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dcd33205-4649-47d5-97fe-da8555b80eb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.184393 Aug 08 02:32:58.288298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 59/101] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:58 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:58.623567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:58.624128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:58.630159 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.630692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.631126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.631819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.633059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.633497 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.769876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:58.778003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-432c5afc-c667-44d3-9149-03745d24fe52 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.158149 Aug 08 02:32:58.778702 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 43/102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:58 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:59.239390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:59.240183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:59.248726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.249241 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.249685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.250422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.250868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.251311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.318526 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:59.318526 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:59.321487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.321975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.322446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.323142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.323586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.323998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.398501 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:59.406598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6a65e882-32ef-4eb4-b8fe-befcae4b294c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.171229 Aug 08 02:32:59.407470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 60/103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:59 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:59.462465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:59.470533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:59.472023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:59.473113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-59d65d6a-6f81-4ae0-a4dc-5a22f727b9c0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.166240 Aug 08 02:32:59.473675 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 44/104] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:32:59 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:32:59.799244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:59.799844 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:59.806922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.807558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.808415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.809123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.809877 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.810388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.996689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:00.005869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ab1a7711-d407-4980-b4a5-d81362b878be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.210303 Aug 08 02:33:00.006845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 61/105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:59 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:00.428124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:00.428967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:00.435550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:00.436115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:00.436624 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:00.437327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:00.437804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:00.438229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:00.496260 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:00.496942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:00.504297 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:00.504801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:00.505264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:00.505962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:00.506436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:00.507115 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:00.591328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:00.600913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-58b31f22-a387-4101-94f1-0bd8add9812d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.176694 Aug 08 02:33:00.613757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 45/106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:00 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:00.677374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:00.685428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:00.687043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:00.688294 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c2f8ce20-8543-4617-89a3-5b5ba355b1b4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.197668 Aug 08 02:33:00.689184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 62/107] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:00 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:01.028349 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:01.029349 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:01.035923 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.036410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.036844 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.037530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.038026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.039456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.197091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:01.204577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d66005fd-a469-4f6a-be32-395e5128fa94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.180586 Aug 08 02:33:01.205141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 46/108] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:01 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:01.621216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:01.621823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:01.627726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.628205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.628632 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.629315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.629761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.630180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.716458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:01.717072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:01.723442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.726371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.726371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.726371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.726371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.726845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.793922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:01.806018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1bf39210-1754-4558-baf9-8097bb5922a5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.188317 Aug 08 02:33:01.807029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 63/109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:01 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:01.871677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:01.879866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:01.881586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:01.882587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c011e401-5203-4e36-827b-731701754d2f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.170675 Aug 08 02:33:01.883156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 47/110] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:01 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:02.227339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:02.228101 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:02.234277 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:02.234780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:02.235208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.235925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:02.236372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:02.236788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.367786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:02.376247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec697541-47d1-4924-9787-792bfd0abc84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.153442 Aug 08 02:33:02.377266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 64/111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:02 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:02.826391 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:02.827002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:02.833112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:02.833583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:02.834007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.834967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:02.836008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:02.836614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.905180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:02.905797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:02.911829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:02.912308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:02.912914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.927311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:02.927810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:02.928932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.983247 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:02.990868 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6c6e0a5a-82fa-4218-ab6d-9c11fb280570 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.168584 Aug 08 02:33:02.991525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 48/112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:02 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:03.059642 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:03.067511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:03.069002 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:03.070250 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-af0ee4de-d324-4ce8-87b9-485c1da72fd2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.169280 Aug 08 02:33:03.070828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 65/113] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:02 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:03.397927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:03.398646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:03.404586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:03.405061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:03.405487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:03.406160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:03.406629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:03.407045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:03.426025 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:03.538944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:03.546474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e50db66f-e7a1-4400-984b-3afdad38825f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.152369 Aug 08 02:33:03.547041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 49/114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:03 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:04.012245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:04.012777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:04.018770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.019245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.019675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.020346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.020791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.021208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.092696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:04.093307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:04.099145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.099844 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.100042 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.100737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.101188 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.101706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.151585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:04.158919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c19fdd55-c2fa-42f4-8320-5edd51abee26 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.150747 Aug 08 02:33:04.159508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 66/115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:04 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:04.232642 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:04.240549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:04.246861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:04.246861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dad8cd1c-a8e4-4179-99e7-3beedda534d8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.155037 Aug 08 02:33:04.246861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 50/116] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:04 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:04.566316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:04.566941 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:04.573606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.574109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.574552 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.575230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.575676 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.576092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.702708 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:04.710455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8649b33c-4067-4dbe-98cb-a74443300f92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.147755 Aug 08 02:33:04.711117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 67/117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:04 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:05.178219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:05.178870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:05.184934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.185414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.185876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.186589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.187040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.187460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.267079 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:05.267678 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:05.274266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.274775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.275202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.275882 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.276327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.276742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.317200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:05.327113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b57373a9-3443-44cb-9eb6-ac5311d9dd28 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.152725 Aug 08 02:33:05.327855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 51/118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:05 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:05.424568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:05.432465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:05.433881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:05.434993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6df85b8e-11df-455f-bbce-a614cb96bfb5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.171888 Aug 08 02:33:05.435547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 68/119] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:05 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:05.730974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:05.731511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:05.737687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.738171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.738713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.739440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.739902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.740322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.871136 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:05.878623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-71cb7335-f934-4f0a-b4ec-a57fa6e1f643 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.151871 Aug 08 02:33:05.879240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 52/120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:05 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:06.350046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:06.350719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:06.356880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.357354 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.357786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.358513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.358960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.359385 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.466048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:06.467232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:06.472998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.473468 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.473968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.474670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.475118 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.483598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.485974 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:06.494060 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fadcc1c1-4ca6-477f-b833-96db14cefa73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.147827 Aug 08 02:33:06.494668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 69/121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:06 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:06.758368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:06.766170 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:06.767713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:06.768806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4978248f-c25f-42d7-9b63-35ac3a6037af tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.306572 Aug 08 02:33:06.769370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 53/122] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:06 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:06.899663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:06.900207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:06.905993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.906497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.906933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.907611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.908066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.908486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.037247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:07.045282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-17957c7c-8404-44fb-a07f-335633039d3f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.149526 Aug 08 02:33:07.045845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 70/123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:06 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:07.513247 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:07.513856 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:07.519986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:07.520514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:07.520948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.521631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:07.522147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:07.523094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.655019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:07.662663 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94564daf-3c15-4c93-8bc9-dea141372120 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153187 Aug 08 02:33:07.663307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 54/124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:07 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:07.791308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:07.791915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:07.797697 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:07.798177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:07.798656 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.799343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:07.799795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:07.800222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.933781 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:07.941522 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:07.943044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:07.944645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d0eecbd5-8836-4f9c-9406-952800d0cdcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.156759 Aug 08 02:33:07.945328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 71/125] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:07 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:08.067149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:08.067769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:08.074627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:08.075090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:08.075509 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:08.076186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:08.076659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:08.077072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:08.206187 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:08.213863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-71d2a0d9-5e4f-45ec-a420-28f043fe9e4c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.150861 Aug 08 02:33:08.214435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 55/126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:08 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:08.683831 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:08.684435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:08.690448 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:08.690929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:08.691360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:08.692712 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:08.693251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:08.693677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:08.823135 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:08.830409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d7468f71-9f42-4562-b4b5-d22ad90b024d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.151475 Aug 08 02:33:08.830961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 72/127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:08 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:08.966549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:08.967200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:08.973063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:08.973533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:08.973951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:08.974644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:08.975085 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:08.975524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.104151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:09.112305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:09.113963 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:09.115082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fa8aabab-bc72-431f-bf32-6a7f1ce26f8c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.152425 Aug 08 02:33:09.115730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 56/128] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:08 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:09.234270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:09.234908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:09.240693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:09.243268 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:09.243268 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.243268 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:09.243595 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:09.244022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.262199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:09.376967 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:09.385464 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bae4b182-71d2-4233-93ff-07d5c06bbb5c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.155041 Aug 08 02:33:09.386031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 73/129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:09 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:09.851457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:09.852141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:09.858313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:09.858764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:09.859195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.859876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:09.860324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:09.860740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.996280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:10.009754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-44dbe8eb-2e48-4ea4-ad70-f353e9922327 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.162642 Aug 08 02:33:10.010326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 57/130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:09 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:10.138806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:10.142987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:10.145310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:10.145794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:10.146226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:10.146938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:10.147382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:10.147803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:10.278230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:10.286216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:10.287795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:10.288885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d6b3a99e-5db5-4b9a-af2a-1458642efa0e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.153985 Aug 08 02:33:10.289542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 74/131] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:10 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:10.406480 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:10.407131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:10.413218 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:10.414382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:10.414382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:10.414863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:10.415312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:10.415734 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:10.547226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:10.555575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-da2c7d61-8f91-4d0d-9bd9-8552e328a619 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.152980 Aug 08 02:33:10.556134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 58/132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:10 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:11.030098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:11.030662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:11.036625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:11.037095 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:11.037524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:11.038200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:11.038767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:11.039455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:11.171662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:11.180167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f61f76f6-0c5b-4b32-b90a-5c58abd0ef02 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153044 Aug 08 02:33:11.180854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 75/133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:11 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:11.311235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:11.311865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:11.317723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:11.318194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:11.318645 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:11.319315 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:11.320293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:11.320730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:11.449219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:11.456946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:11.458462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:11.459795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-234b0240-e06c-4d00-9f30-69eab7a44136 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.152575 Aug 08 02:33:11.461468 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 59/134] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:11 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:11.576073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:11.576614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:11.582509 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:11.582995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:11.583430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:11.584361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:11.584811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:11.585253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:11.712600 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:11.719997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7c231b40-f478-42b7-8f96-308faf55600b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.147851 Aug 08 02:33:11.720561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 76/135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:11 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:12.200711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:12.201314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:12.207158 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:12.207629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:12.208056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:12.208728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:12.209420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:12.209832 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:12.341993 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:12.349297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c3510458-d1e4-4453-9e5b-2cd035cdc8a4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.152368 Aug 08 02:33:12.349854 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 60/136] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:12 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:12.482986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:12.483591 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:12.489450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:12.489930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:12.490377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:12.491062 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:12.492073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:12.492611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:12.622890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:12.630673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:12.636899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:12.636899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3c2505f8-8cf5-4713-90c8-9b6f2255094e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.155443 Aug 08 02:33:12.636899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 77/137] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:12 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:12.740599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:12.741207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:12.747610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:12.748084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:12.748512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:12.749183 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:12.749628 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:12.750041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:12.877804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:12.885280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4b10c5ab-7c2e-4137-bf6d-50a5aadee4ae tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.148486 Aug 08 02:33:12.885842 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 61/138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:12 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:13.368983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:13.369619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:13.375531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:13.376008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:13.376443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:13.377122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:13.377571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:13.377994 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:13.505873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:13.513465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-513d23df-7f70-4c2f-b878-8597989240da tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.148473 Aug 08 02:33:13.514067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 78/139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:13 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:13.656664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:13.657269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:13.663177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:13.663769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:13.664201 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:13.664879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:13.665331 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:13.665753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:13.794813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:13.802576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:13.804067 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:13.805139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-eeb4a437-625e-4d2e-99a4-f16193742a82 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.152360 Aug 08 02:33:13.805695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 62/140] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:13 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:13.905721 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:13.906415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:13.912348 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:13.912813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:13.913239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:13.913913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:13.914371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:13.915342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:14.045271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:14.052572 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c25c3d63-8716-41be-a26a-ce2a7218469e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.150846 Aug 08 02:33:14.053112 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 79/141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:13 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:14.534244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:14.534899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:14.542044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:14.542602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:14.543031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:14.543716 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:14.544162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:14.544579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:14.675367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:14.683408 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-788bcf31-115c-4484-8d8a-82b2cb173298 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153009 Aug 08 02:33:14.683969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 63/142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:14 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:14.826574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:14.827167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:14.833158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:14.833637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:14.834315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:14.835009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:14.835452 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:14.835870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:14.973261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:14.979393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:14.980904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:14.985346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7cf13fd1-7c54-4a49-8852-d1fdf416ce57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.162616 Aug 08 02:33:14.986028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 80/143] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:14 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:15.074888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:15.075773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:15.081889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:15.082581 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:15.083147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:15.084303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:15.084743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:15.085302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:15.232580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:15.240454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9428cec5-6d0f-4e16-831a-0a067607bd84 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.171193 Aug 08 02:33:15.241501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 64/144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:15 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:15.703586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:15.704218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:15.710286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:15.710785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:15.711214 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:15.712009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:15.712972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:15.713396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:15.842441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:15.849841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d6fdf538-712d-4fa0-8471-efaca15adf84 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.149998 Aug 08 02:33:15.850421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 81/145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:15 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:16.346128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:16.346128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:16.346128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:16.346128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:16.347621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:16.347621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:16.347621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:16.347621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:16.347937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:16.347937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:16.348235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:16.348235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-461e74f3-d849-45c6-8a4d-5923ba699a0d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.155652 Aug 08 02:33:16.348235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 65/146] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:16 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:16.348498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:16.348498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:16.348498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:16.348498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:16.348920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:16.348920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:16.348920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:16.348920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:16.399362 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:16.407657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-151ae4de-6ff4-4560-ac79-03ba75582578 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.148664 Aug 08 02:33:16.408222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 82/147] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:16 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:16.870310 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:16.870939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:16.877082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:16.877501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:16.877928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:16.878652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:16.879102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:16.879538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:16.883934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:17.029356 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:17.037608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8d3acdd1-f2df-43f5-be77-3e295879235d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.171308 Aug 08 02:33:17.040754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 66/148] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:16 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:17.204820 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:17.205473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:17.211744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:17.212263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:17.212771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:17.213506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:17.213950 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:17.214387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:17.216778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-3c4403a6-7d62-4c24-a4c4-f63a924227c4 req-c5085b4a-ea22-4af3-965d-8c31ba53844c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4449d47c-fbac-4e23-8017-0a283a5ba7d9", "name": "network-vif-plugged", "status": "completed", "tag": "b02fabe8-9ace-422a-a568-18c37daa63c2"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:17.226620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3c4403a6-7d62-4c24-a4c4-f63a924227c4 req-c5085b4a-ea22-4af3-965d-8c31ba53844c service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:17.233527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3c4403a6-7d62-4c24-a4c4-f63a924227c4 req-c5085b4a-ea22-4af3-965d-8c31ba53844c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:17.233527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3c4403a6-7d62-4c24-a4c4-f63a924227c4 req-c5085b4a-ea22-4af3-965d-8c31ba53844c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:17.238299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-3c4403a6-7d62-4c24-a4c4-f63a924227c4 req-c5085b4a-ea22-4af3-965d-8c31ba53844c service nova] Creating event network-vif-plugged:b02fabe8-9ace-422a-a568-18c37daa63c2 for instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 on hv-cinder-85226 Aug 08 02:33:17.243870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-3c4403a6-7d62-4c24-a4c4-f63a924227c4 req-c5085b4a-ea22-4af3-965d-8c31ba53844c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094038 Aug 08 02:33:17.244464 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 83/149] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:17.360179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:17.368257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:17.369787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:17.371012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2442e3df-a3c6-4c64-bafe-fbce7415a0ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.169976 Aug 08 02:33:17.371512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 67/150] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:17 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:17.429148 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:17.429780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:17.436189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:17.436663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:17.437097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:17.437778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:17.438232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:17.438678 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:17.574529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:17.581951 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fa5f52d9-6fcd-4ee7-b332-65a228a0dc7b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.157033 Aug 08 02:33:17.582556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 84/151] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:17 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:18.058832 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:18.059531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:18.065425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:18.065904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:18.072241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:18.072241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:18.072241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:18.072241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:18.201543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:18.209207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c68bb572-b932-42e7-af31-9d2067275934 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.154506 Aug 08 02:33:18.209804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 68/152] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:18 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:18.397617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:18.398208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:18.408064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:18.408064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:18.408064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:18.408064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:18.408400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:18.408400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:18.544760 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:18.552796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:18.557569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:18.558741 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-19490ead-f372-4930-8eff-e6fecdcdaf22 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.165008 Aug 08 02:33:18.559428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 85/153] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:18 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:18.603964 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:18.604575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:18.610565 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:18.611042 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:18.611613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:18.612311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:18.612760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:18.613180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:18.747504 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:18.756747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b6adcf0d-935d-4a0e-8a76-75ffb9319128 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.157261 Aug 08 02:33:18.757343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 69/154] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:18 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:19.229539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:19.230199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:19.236342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:19.236827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:19.237261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:19.237957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:19.238499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:19.240401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:19.421725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:19.429203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4b980e64-58f9-4ee7-ad7d-b3462a35a315 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.203716 Aug 08 02:33:19.429772 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 86/155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:19 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:19.586858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:19.588122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:19.594476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:19.594953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:19.595406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:19.596288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:19.596729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:19.597169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:19.728547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:19.736431 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:19.737932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:19.739056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-392dd58f-f6ff-4ffa-a5b1-be3edf502301 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.156424 Aug 08 02:33:19.739872 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 70/156] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:19 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:19.776891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:19.777530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:19.779645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=86 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:19.784574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:19.785051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:19.785749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:19.786470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:19.786920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:19.787469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:19.928574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:19.937113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3289e136-cb88-44e7-97ab-257fcf5c352c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.163979 Aug 08 02:33:19.937683 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 87/157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:19 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:20.450666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:20.451277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:20.457232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:20.457711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:20.458139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:20.459106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:20.459554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:20.459974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:20.594310 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:20.603378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-587c42da-381c-4190-82c3-d7a6ae2b2bbf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.157139 Aug 08 02:33:20.604150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 71/158] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:20 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:20.764279 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:20.764279 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:20.768150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:20.768637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:20.769081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:20.769780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:20.770233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:20.770690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:20.909357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:20.917456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:20.918984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:20.920278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-824c4db4-312f-4199-88a0-5688540bc7bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.163374 Aug 08 02:33:20.920824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 88/159] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:20 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:20.967009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:20.967009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:20.967009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:20.967009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:20.967893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:20.967893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:20.967893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:20.967893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:21.105377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:21.112769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9dbf5dae-3230-4263-bff9-934c3889ca26 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.158895 Aug 08 02:33:21.113335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 72/160] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:20 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:21.623765 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:21.624392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:21.630268 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:21.630779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:21.631205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:21.631884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:21.632327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:21.632742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:21.768618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:21.776564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5f7e5279-f5ae-4ad6-a438-938c6df548e7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.156577 Aug 08 02:33:21.777131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 89/161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:21 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:21.943997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:21.944836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:21.951657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:21.952134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:21.954026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:21.954818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:21.955270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:21.955874 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:22.114564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:22.124562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:22.126153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:22.127646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a9e60020-5736-4f67-90af-06dfd1045fe1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.187273 Aug 08 02:33:22.128706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 73/162] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:21 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:22.135888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:22.136784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:22.143257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:22.147803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:22.147803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:22.147803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:22.147803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:22.148220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:22.282915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:22.282915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:22.285096 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e2b45843-803f-4b8c-ab34-6c406effbe8e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.153979 Aug 08 02:33:22.285667 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 90/163] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:22 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:22.796925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:22.797492 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:22.799355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=78 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:22.803960 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:22.804432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:22.804858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:22.805534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:22.805977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:22.806499 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:22.945447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:22.953720 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1fd5a49f-1b03-4717-acdb-fb3388a1c106 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.160627 Aug 08 02:33:22.954291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 74/164] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:22 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:23.151854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:23.152469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:23.159203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:23.159690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:23.160125 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:23.160823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:23.161278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:23.161704 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:23.312192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:23.313419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:23.315727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:23.320672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:23.321380 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:23.322483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:23.323430 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:23.323952 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:23.324463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:23.325536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:23.333256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:23.333256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-541581a5-6dc5-486b-92cf-76b667358bf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.180953 Aug 08 02:33:23.333256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 91/165] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:23 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:23.470419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:23.478140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e2df3f9a-eb8c-45c1-80dc-2c2b2f98229e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.170223 Aug 08 02:33:23.478996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 75/166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:23 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:23.974519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:23.975136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:23.981172 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:23.981649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:23.982083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:23.982790 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:23.983240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:23.983664 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:24.283317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:24.291631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a7f187e2-41ce-4d61-a7bf-178bd50f3482 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.320751 Aug 08 02:33:24.292275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 92/167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:23 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:24.351545 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:24.352147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:24.358279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:24.358861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:24.359292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:24.359968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:24.360411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:24.360825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:24.490299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:24.499217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:24.500111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:24.500699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:24.500811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:24.501795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b0a7fea5-811f-4787-8929-ec12e734f18f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.154115 Aug 08 02:33:24.502367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 76/168] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:24 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:24.506605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:24.507085 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:24.507519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:24.508208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:24.508669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:24.509093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:24.644077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:24.651501 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c95ab1fc-bc77-42d9-a57b-0db30fc73ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.155364 Aug 08 02:33:24.652065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 93/169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:24 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:25.312222 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:25.312912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:25.318759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:25.319375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:25.319631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:25.320305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:25.320742 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:25.321157 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:25.450847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:25.458207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-487f6a8a-15e2-4e45-9914-51b4c9cdcbc6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.149821 Aug 08 02:33:25.459243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 77/170] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:25 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:25.524999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:25.525603 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:25.531581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:25.532054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:25.532483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:25.533166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:25.533612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:25.534041 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:25.667158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:25.672138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:25.672853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:25.675381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:25.676878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:25.677974 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ca84a72f-2f8c-4413-ad7f-d302131fe24f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.157005 Aug 08 02:33:25.678549 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 94/171] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:25 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:25.678808 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:25.679281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:25.679702 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:25.680378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:25.680819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:25.681777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:25.807736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:25.815110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-57f48181-4f40-4e10-9b89-838da277579d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.146755 Aug 08 02:33:25.815625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 78/172] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:25 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:26.479914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:26.480542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:26.486593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:26.487386 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:26.487515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:26.488240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:26.488684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:26.489102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:26.625202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:26.633685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-96c6ae1a-aada-4dd8-8fa8-919c57e6d6de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.157064 Aug 08 02:33:26.633685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 95/173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:26 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:26.701677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:26.702293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:26.709014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:26.709524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:26.709916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:26.710641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:26.711091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:26.711512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:26.836528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:26.837252 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:26.843671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:26.844239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:26.844749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:26.845508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:26.846046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:26.846653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:26.860686 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:26.873580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:26.875099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:26.876541 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-adabcc86-9659-48e8-be7b-c4d1a19f0559 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.179331 Aug 08 02:33:26.877107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 79/174] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:26 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:26.983914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:26.992001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-63ca881a-001d-46f6-90f4-0cbacefdf9a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.160133 Aug 08 02:33:26.992566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 96/175] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:26 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:27.656502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:27.657044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:27.662879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:27.663351 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:27.663775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:27.664454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:27.664897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:27.665971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:27.797177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:27.805316 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ebb0f77a-b399-4172-a1ee-74704a4af0fa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.152624 Aug 08 02:33:27.805998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 80/176] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:27 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:27.900385 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:27.901093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:27.907145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:27.907574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:27.908010 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:27.908696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:27.909151 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:27.909579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:28.013946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:28.014592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:28.020424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:28.020900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:28.021324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:28.022002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:28.022558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:28.022973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:28.039684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:28.048065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:28.049888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:28.051014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b0fd348d-8e33-4a8e-ae1a-373ba7382458 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.155309 Aug 08 02:33:28.051563 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 97/177] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:27 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:28.158039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:28.165479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-797f5b32-e829-4944-b302-8d3489de9d18 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.155403 Aug 08 02:33:28.166064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 81/178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:28 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:28.569780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-89b60160-8469-4309-9572-0339cb3e7a36 req-392814f8-f6c0-439e-9a2d-f6bd4be1bc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf3b2b7-8778-4f17-b615-2dad95f66ecb", "name": "network-vif-plugged", "status": "completed", "tag": "75f505e8-1b29-4894-a1e1-92ef1e0c2996"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:28.580611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-89b60160-8469-4309-9572-0339cb3e7a36 req-392814f8-f6c0-439e-9a2d-f6bd4be1bc26 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:28.581086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-89b60160-8469-4309-9572-0339cb3e7a36 req-392814f8-f6c0-439e-9a2d-f6bd4be1bc26 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:28.581518 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-89b60160-8469-4309-9572-0339cb3e7a36 req-392814f8-f6c0-439e-9a2d-f6bd4be1bc26 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:28.592575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-89b60160-8469-4309-9572-0339cb3e7a36 req-392814f8-f6c0-439e-9a2d-f6bd4be1bc26 service nova] Creating event network-vif-plugged:75f505e8-1b29-4894-a1e1-92ef1e0c2996 for instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb on hv-cinder-85226 Aug 08 02:33:28.597626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-89b60160-8469-4309-9572-0339cb3e7a36 req-392814f8-f6c0-439e-9a2d-f6bd4be1bc26 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Aug 08 02:33:28.599509 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 98/179] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:28.824936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:28.825581 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:28.831505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:28.832051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:28.832442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:28.833127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:28.833836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:28.834256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:29.004197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:29.007881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:29.012468 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5ca1bdfc-3286-476e-8c24-6fd1c6c3869d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.191448 Aug 08 02:33:29.013032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 82/180] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:28 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:29.073576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:29.074410 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:29.080468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:29.080938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:29.084684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:29.084684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:29.084684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:29.084684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:29.187743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:29.188834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:29.196730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:29.197531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:29.199051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:29.199051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:29.200137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:29.200924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:29.237769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:29.246338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:29.258248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:29.258248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-95bf4ad7-d601-437a-a040-53ca3a038235 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.179876 Aug 08 02:33:29.258248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 99/181] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:29 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:29.343973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:29.351333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0b72e4ed-a21d-4988-824e-a54fd451282b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.169950 Aug 08 02:33:29.351906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 83/182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:29 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:30.034719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:30.035621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:30.042817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:30.043299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:30.043966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:30.044918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:30.045598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:30.046394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:30.199377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:30.224063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4dc54811-60ab-44e3-84bc-da0d9349988c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.194096 Aug 08 02:33:30.224657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 100/183] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:30 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:30.279057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:30.280307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:30.287129 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:30.287867 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:30.288508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:30.289382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:30.291069 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:30.291777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:30.381673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:30.385253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:30.395143 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:30.397489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:30.397930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:30.398672 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:30.399429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:30.401968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:30.497901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:30.512073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:30.512073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:30.512404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-beb3e2fc-6553-40c2-bae9-c874ea966df3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.237762 Aug 08 02:33:30.527213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 84/184] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:30 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:30.595019 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:30.604542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4eeaf4b8-0e9c-4333-acaa-22ff164bede6 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.234809 Aug 08 02:33:30.605506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 101/185] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:30 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:31.251953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:31.253333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:31.260974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:31.261551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:31.262266 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:31.263022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:31.263470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:31.266703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:31.417599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:31.427694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-378ffe58-41de-4ea7-8925-91cb4523e740 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.182230 Aug 08 02:33:31.429308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 85/186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:31 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:31.536098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:31.536703 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:31.543791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:31.544321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:31.544939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:31.545633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:31.546240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:31.546694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:31.626912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:31.627616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:31.634522 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:31.635093 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:31.635614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:31.636378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:31.636901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:31.637401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:31.738750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:31.760417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:31.761839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:31.765078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-611359e3-7e41-4d3d-bb35-ec4d29b80074 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.231145 Aug 08 02:33:31.765078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 102/187] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:31 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:31.780882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:31.790693 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-608a1a1e-d0b4-42c0-b951-e09a73beb6ea tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.168880 Aug 08 02:33:31.793035 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 86/188] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:31 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:32.457114 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:32.457826 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:32.464727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:32.467436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:32.467436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:32.467436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:32.467436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:32.468007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:32.599174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:32.606999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec356a46-3f68-449d-9213-e19b9efa1b2e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153890 Aug 08 02:33:32.607573 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 103/189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:32 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:32.787680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:32.788302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:32.795538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:32.796024 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:32.796452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:32.797151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:32.797602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:32.798023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:32.812894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:32.813956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:32.823015 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:32.823821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:32.824458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:32.825521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:32.826192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:32.826844 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.006108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:33.016095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:33.017447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:33.019434 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a5e0514f-c4c1-449c-afcf-cdfdcb5e5098 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.236160 Aug 08 02:33:33.019992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 87/190] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:32 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:33.068608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:33.078579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-753a9a00-8579-48de-a69e-f6fa228e34aa tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.269909 Aug 08 02:33:33.091761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 104/191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:32 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:33.630034 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:33.631165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:33.639161 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.639707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.640137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.640875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.641324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.641743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.804543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:33.812090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-160989de-1f8f-4ce3-8892-63ffedf4083b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.187490 Aug 08 02:33:33.812584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 88/192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:33 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:34.048971 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:34.049574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:34.056093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.056618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.057057 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.057827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.058283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.059123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.101693 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:34.102329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:34.108448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.109008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.109583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.110446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.111019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.111588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.207768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:34.216355 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:34.218131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:34.219265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ab26c01-60b8-4f78-b609-183aa13a2ac4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.174248 Aug 08 02:33:34.219824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 105/193] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:34 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:34.251688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:34.260334 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c22e567b-1da5-4c11-9bfa-c2c11d41d6bf tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.162162 Aug 08 02:33:34.260897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 89/194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:34 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:34.833058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:34.833926 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:34.842724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.843271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.843728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.844564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.845073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.845519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.034885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:35.043001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b1e91cfa-6005-4e98-822b-89635bbea189 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.213686 Aug 08 02:33:35.043583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 106/195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:34 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:35.241119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:35.241723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:35.248143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.248889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.249199 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.249887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.250339 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.250781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.281623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:35.282377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:35.288405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.289023 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.289451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.290143 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.291332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.293035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.449235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:35.455893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:35.456759 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9d037882-664d-4272-8652-dfb872629d87 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.179149 Aug 08 02:33:35.457329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 107/196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:35 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:35.465771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:35.468008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:35.469722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a97eb777-0c19-4883-a0f7-61dcb38fad85 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.232540 Aug 08 02:33:35.470533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 90/197] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:35 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:36.064451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.065305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.071289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.071794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.072228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.072905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.073358 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.074222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.078211 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:36.213490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.221270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1763ec66-452d-4463-a8ad-78f1d8a2b6c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.160547 Aug 08 02:33:36.222036 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 108/198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:36 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:36.483826 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.488507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.490595 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.491074 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.491498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.492228 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.492671 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.493082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.493487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.494208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.502067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.502855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.503576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.504522 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.505093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.505736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.649126 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.657404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.658945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.660042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fb8bd5bf-9c36-4cb6-9a6d-24342c245fdb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.172003 Aug 08 02:33:36.660598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 109/199] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:36 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:36.685056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.692604 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0b4bf1e7-6478-4c7e-954e-0358822bd38e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.216292 Aug 08 02:33:36.693313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 91/200] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:36 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:37.247596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:37.248288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:37.254209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.254718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.255148 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.255829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.256268 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.256683 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.393794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:37.410824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-319c6423-783a-4b7f-9fb7-eff75709aefa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.167089 Aug 08 02:33:37.425497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 110/201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:37 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:37.683241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:37.683856 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:37.690592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.691090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.691708 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.692409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.693139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.693557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.725335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:37.730063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:37.740240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.743294 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.743873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.745504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.746081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.746662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.877478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:37.886435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:37.886435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:37.887318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5c004d15-ab2f-40a1-ad95-81e1882d20a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.208952 Aug 08 02:33:37.888038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 92/202] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:37 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:37.935055 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:37.943233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ccc96d4f-f2b5-4410-b7dd-1997a4e4483e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.232223 Aug 08 02:33:37.944103 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 111/203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:37 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:38.432824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:38.433521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:38.439625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.440012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.440443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.441338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.441941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.442555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.486254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-d3f51701-e240-4161-8305-4f85fccaced3 req-71b9b004-2f54-4b1a-a70f-1217d5320df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "name": "network-vif-plugged", "status": "completed", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:38.495465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-d3f51701-e240-4161-8305-4f85fccaced3 req-71b9b004-2f54-4b1a-a70f-1217d5320df0 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.496454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-d3f51701-e240-4161-8305-4f85fccaced3 req-71b9b004-2f54-4b1a-a70f-1217d5320df0 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.497083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-d3f51701-e240-4161-8305-4f85fccaced3 req-71b9b004-2f54-4b1a-a70f-1217d5320df0 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.510624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-d3f51701-e240-4161-8305-4f85fccaced3 req-71b9b004-2f54-4b1a-a70f-1217d5320df0 service nova] Creating event network-vif-plugged:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:33:38.516282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-d3f51701-e240-4161-8305-4f85fccaced3 req-71b9b004-2f54-4b1a-a70f-1217d5320df0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039241 Aug 08 02:33:38.516893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 112/204] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:33:38.677175 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:38.695305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2c553d8d-d3fe-4aae-8274-4d4ccab60bd6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.266800 Aug 08 02:33:38.696523 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 93/205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:38 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:38.909622 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:38.910340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:38.920908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.920908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.920908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.920908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.922158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.922158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.967221 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:38.968080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:38.980114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.980664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.981141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.981787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.982232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.982846 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.096862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.107517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.109089 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.110390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-39b576fb-ab2f-402d-8a30-297dde4e834a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.204999 Aug 08 02:33:39.112842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 113/206] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:38 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:39.154452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.161859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d33cf1ab-5c74-42b4-bb47-a34cf6757a9d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.200517 Aug 08 02:33:39.162439 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 94/207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:38 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:39.718823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:39.719401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:39.725213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.725688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.726123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.727025 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.727480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.727906 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.902492 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.917940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0b3b2c2c-6b08-4921-81ba-05a6a9d51b47 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.202336 Aug 08 02:33:39.919844 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 114/208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:39 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:40.132799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:40.133393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:40.139241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.139713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.140139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.140823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.141284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.141792 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.182257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:40.182914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:40.188900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.189381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.189823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.190560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.191014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.191438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.282304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:40.290954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:40.293105 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:40.294279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0768b788-67c5-4216-a74e-fbc7ff33103d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.165289 Aug 08 02:33:40.306542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 95/209] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:40 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:40.341498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:40.349564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b7dcf9d2-e0f0-489b-b23d-0daec38a6ee5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.171046 Aug 08 02:33:40.350206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 115/210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:40 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:40.938987 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:40.939598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:40.945976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.946482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.946912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.947597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.948044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.948462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.257185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:41.265109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d61628da-a1c1-4c93-812b-7c4d70eae562 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.329998 Aug 08 02:33:41.266400 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 96/211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:40 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:41.316696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:41.317378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:41.323338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:41.323844 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:41.324273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.324960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:41.325412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:41.325837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.372019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:41.372662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:41.378610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:41.379083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:41.379506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.380181 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:41.380662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:41.381072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.467453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:41.484256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:41.486748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:41.487011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9ff3b3ee-f4a7-4084-89b6-fa42a28cfb96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.174268 Aug 08 02:33:41.487744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 116/212] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:41 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:41.529649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:41.537091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e3f4fd40-209e-4b09-8b80-415d114bca94 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.170105 Aug 08 02:33:41.537751 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 97/213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:41 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:42.285887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:42.285887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:42.291558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:42.292088 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:42.292740 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:42.293452 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:42.293906 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:42.294333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:42.425432 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:42.432699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-73c10d83-a11c-4e77-83ed-b02467056f0d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.151565 Aug 08 02:33:42.433801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 117/214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:42 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:42.509127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:42.509729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:42.516484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:42.516907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:42.517335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:42.518021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:42.518598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:42.519026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:42.558824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:42.559481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:42.565611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:42.566098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:42.566569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:42.567266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:42.570547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:42.570547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:42.720727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:42.722260 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:42.731040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:42.732459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-851b1747-f18c-42f3-a64f-bc619608b71d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.178105 Aug 08 02:33:42.732977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:42.733443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 118/215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:42 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:42.735359 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-736bf35c-5874-47bc-bdd4-484861d43b8a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.230125 Aug 08 02:33:42.736079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 98/216] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:42 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:43.453721 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:43.454333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:43.460646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.461209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.461905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.462904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.463310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.463736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.608306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:43.615792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-15b2db6b-d01a-41f6-9edb-781c969af344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.166312 Aug 08 02:33:43.616361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 119/217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:43 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:43.754381 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:43.755114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:43.758202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:43.758580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:43.761970 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.762537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.763005 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.763693 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.764141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.764700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.765340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.766018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.766619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.767660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.768111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.768528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.784209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:43.905265 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:43.909235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:43.912800 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-32c7f6fa-e15e-4233-8843-dfa237094d7e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.162333 Aug 08 02:33:43.913763 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 99/218] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:43 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:43.917420 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:43.919254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:43.920373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-94d2924d-732b-48b4-a502-815164ce323f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.167240 Aug 08 02:33:43.923752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 120/219] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:43 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:44.644654 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:44.645196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:44.652412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.652795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.653228 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.653921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.654345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.654781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.782081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:44.789546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c593b33c-3a0b-4119-b26d-35e990864d9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.148818 Aug 08 02:33:44.790107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 100/220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:44 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:44.934095 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:44.934728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:44.940748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.941261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.941699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.942413 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.942870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.943299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.943457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:44.944079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:44.950542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.951012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.951433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.952108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.952548 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.952958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.078023 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.085747 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b6073996-406a-4b14-a46d-35d306999ee4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.155956 Aug 08 02:33:45.086318 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 121/221] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:44 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:45.086861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.095142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.096623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.097764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-157417f3-f312-408d-8b3b-3f2dbf023256 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.158121 Aug 08 02:33:45.098313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 101/222] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:44 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:45.810057 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:45.810684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:45.816732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:45.817214 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:45.817650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.818393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:45.818851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:45.819276 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.946880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.954868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f79c6d20-ee91-4670-8e84-7f08ae15742b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.148899 Aug 08 02:33:45.955433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 122/223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:45 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:46.106534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:46.107060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:46.113097 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.113570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.119186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.119186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.119186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.119186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.121057 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:46.121658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:46.127521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.127999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.128431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.129124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.129575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.129997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.249460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:46.257129 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5dd99296-b86e-4770-be98-0e674eafd616 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.154688 Aug 08 02:33:46.257849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 102/224] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:46 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:46.262151 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:46.270086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:46.271696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:46.272795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b9c1951e-6621-47bb-8070-b117c04e6a5a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.156551 Aug 08 02:33:46.273348 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 123/225] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:46 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:46.976225 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:46.976833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:46.983557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.984037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.984472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.985154 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.985605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.986026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.122885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.126015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f778890a-6575-438d-a1b3-c626274e26bb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153698 Aug 08 02:33:47.126610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 103/226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:46 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:47.278895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:47.279501 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:47.285497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.285981 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.286455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.287153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.287606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.288033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.295202 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:47.295806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:47.301812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.302287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.302749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.303593 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.304200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.304634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.424188 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.431735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f7af088f-0d24-4803-a710-594a71049381 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.157409 Aug 08 02:33:47.432562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 124/227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:47 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:47.434776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.442799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.444376 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.445539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1b46330a-8d7b-42dd-b558-cb7c6bd6cde9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.154480 Aug 08 02:33:47.446119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 104/228] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:47 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:48.145673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:48.146201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:48.152161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.152663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.153088 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.153759 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.154204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.154648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.173594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:48.286970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:48.295001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4ffa1430-c4b2-40d6-bf53-6f8bb8cc9aa0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153169 Aug 08 02:33:48.295555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 125/229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:48 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:48.453418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:48.453983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:48.460730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.461216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.461656 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.462437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.462894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.463314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.469037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:48.469912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:48.476662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.477137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.477567 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.478255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.478748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.479165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.598707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:48.606062 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4a00680d-a427-4487-8b76-91248d87b4be tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.156549 Aug 08 02:33:48.606668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 105/230] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:48 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:48.616477 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:48.625461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:48.627006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:48.628147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-58467333-e382-47a3-842a-82fe6794330a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.163411 Aug 08 02:33:48.628707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 126/231] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:48 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:48.853799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-2276b192-726d-471d-a343-157571fa2e76 req-61021828-eec0-45a8-8f3b-9932980a0086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b383010a-a42d-40bb-87aa-88500e694738", "name": "network-vif-plugged", "status": "completed", "tag": "b09b9826-f63f-4724-9a75-a75195d2391a"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:48.864826 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-2276b192-726d-471d-a343-157571fa2e76 req-61021828-eec0-45a8-8f3b-9932980a0086 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.865319 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-2276b192-726d-471d-a343-157571fa2e76 req-61021828-eec0-45a8-8f3b-9932980a0086 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.865750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-2276b192-726d-471d-a343-157571fa2e76 req-61021828-eec0-45a8-8f3b-9932980a0086 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.877607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-2276b192-726d-471d-a343-157571fa2e76 req-61021828-eec0-45a8-8f3b-9932980a0086 service nova] Creating event network-vif-plugged:b09b9826-f63f-4724-9a75-a75195d2391a for instance b383010a-a42d-40bb-87aa-88500e694738 on hv-cinder-85226 Aug 08 02:33:48.882706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-2276b192-726d-471d-a343-157571fa2e76 req-61021828-eec0-45a8-8f3b-9932980a0086 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Aug 08 02:33:48.883366 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 106/232] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:49.316797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:49.317420 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:49.323444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.324131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.324580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.325273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.325741 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.326170 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.458787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.466993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1062c251-6770-40ec-a42b-cbd356a5f93a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.153937 Aug 08 02:33:49.467837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 127/233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:49 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:49.627544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:49.628167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:49.634148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.634741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.635068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.636767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.637232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.637646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.652264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:49.652953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:49.658894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.659363 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.659798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.660473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.660917 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.661406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.798754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.806217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0d2050b6-8a32-464c-811b-342a20825eb5 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.182884 Aug 08 02:33:49.806821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 107/234] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:49 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:49.828496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.836984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.838507 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.840295 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1522a5e2-f5a7-44a4-a6a2-cd4b95395457 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.192746 Aug 08 02:33:49.840798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 128/235] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:49 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:50.487862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:50.488467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:50.494520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.494998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.496043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.496727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.497403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.497614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.625707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:50.633162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-10defd48-7d6c-4ead-94fe-e9e001392bb9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.149152 Aug 08 02:33:50.633727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 108/236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:50 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:50.827208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:50.827867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:50.829701 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=84 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:50.834669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.835195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.835631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.836351 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.836824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.837251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.863113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:50.863848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:50.869738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.870885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.871098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.871862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.872320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.872744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.969572 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:50.976923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f9c4cd8a-d3dc-405e-9cf9-b674a293f773 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.153635 Aug 08 02:33:50.977492 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 129/237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:50 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:51.008365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:51.017599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:51.019126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:51.020220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b3a5d96f-f3c5-468c-abf2-be0b16600342 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.160991 Aug 08 02:33:51.020764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 109/238] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:50 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:51.653454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:51.654060 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:51.660782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.661259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.661685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.662381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.662841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.663263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.796123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:51.804604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-abd90c2c-637d-49cc-87a6-f46c3cc2cfda tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.154913 Aug 08 02:33:51.805162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 130/239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:51 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:51.999112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:51.999638 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:52.005619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.006083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.006535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.007240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.007680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.008089 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.043257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:52.044126 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:52.050392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.050948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.051449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.052232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.052916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.053411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.147237 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:52.155178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2839be0a-7741-4c77-ad6f-b95c823bddfd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.160613 Aug 08 02:33:52.156143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 110/240] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:51 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:52.192117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:52.201468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:52.202984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:52.204082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b51199a9-3a68-4736-8917-047b6b9033b0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.165098 Aug 08 02:33:52.204682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 131/241] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:52 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:33:52.826764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:52.832195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:52.838536 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.839808 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.840407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.841104 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.843048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.843489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.984241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:52.991629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d7b8534f-9204-4029-9d00-347f39362fb0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.170603 Aug 08 02:33:52.992189 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 111/242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:52 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:53.176024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:53.176628 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:53.183367 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:53.183856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:53.184292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:53.184996 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:53.185444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:53.185859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:53.228160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:53.228772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:53.235535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:53.236015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:53.236442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:53.237139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:53.237588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:53.238006 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:53.325775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:53.333516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b6a1b6d7-ed2b-4c02-be82-8adc8f4dec4d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.161295 Aug 08 02:33:53.334207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 132/243] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:53 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:53.373245 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:53.381372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:53.382926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:53.384012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c31797ba-e064-4374-bade-f5e62cb95726 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.160841 Aug 08 02:33:53.384614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 112/244] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:53 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:54.012951 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:54.013550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:54.019394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.019864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.020296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.020970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.021416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.021839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.152678 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:54.160095 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-88f0a1fb-8df6-433a-8aac-6dd7eb273917 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.151529 Aug 08 02:33:54.160665 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 133/245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:54 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:54.355577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:54.356086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:54.358178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=78 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:54.362806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.363284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.363710 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.364390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.364836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.365258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.407303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:54.407909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:54.413748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.414224 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.414695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.415383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.415831 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.416437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.501370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:54.508736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8dad2e1d-dc3a-46b3-99ce-d3f9dc767f71 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.158062 Aug 08 02:33:54.517133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 113/246] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:54 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:54.551397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:54.559399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:54.560948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:54.562032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0754942f-68d4-4c08-bca3-d6339e0f02bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.158569 Aug 08 02:33:54.562632 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 134/247] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:54 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:55.180946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:55.181543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:55.188207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.188678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.189099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.189765 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.190204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.190637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.324997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:55.332350 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e6781430-e3b4-4699-99af-7e5cf0d5a746 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.155216 Aug 08 02:33:55.333183 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 114/248] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:55 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:55.529358 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:55.529969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:55.535923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.536392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.536823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.537497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.537943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.538380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.584185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:55.584771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:55.591140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.591610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.592031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.592705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.593152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.593566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.672651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:55.682045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cc54dbdc-e572-4af2-be8d-787e9642233e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.156465 Aug 08 02:33:55.683450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 135/249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:55 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:55.734297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:55.742066 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:55.743610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:55.745337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0466005a-0763-4d9f-8014-48734f878825 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.164713 Aug 08 02:33:55.745968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 115/250] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:55 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:56.353576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:56.353576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:56.359370 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.359898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.360342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.361032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.361487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.361914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.496599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:56.503982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3d3630bd-9e96-42cf-ab79-40e390bcbcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.155074 Aug 08 02:33:56.504522 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 136/251] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:56 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:56.705242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:56.705870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:56.712390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.712864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.713290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.714176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.714474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.714828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.767344 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:56.769006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:56.778674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.779157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.779773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.783659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.783953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.784481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.877512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:56.881114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:56.886671 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-31b77928-056e-4636-9c44-40b583f38b95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.185246 Aug 08 02:33:56.887645 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 116/252] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:56 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:56.942105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:56.951554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:56.953649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:56.954846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-03c42d92-9883-4f42-83eb-e5e37a5f1d91 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.191194 Aug 08 02:33:56.955757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 137/253] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:56 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:57.526387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:57.526912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:57.532966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.533437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.533862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.537165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.537165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.537165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.666304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:57.673824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-87680970-fe90-40bd-9b17-75864392f628 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.152821 Aug 08 02:33:57.674428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 117/254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:57 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:57.907460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:57.908060 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:57.913927 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.914884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.915245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.915947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.916403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.917540 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.977092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:57.978255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:57.985610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.986325 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.986949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.987875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.988582 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.989151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:58.079736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:58.088266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e4c12d15-0677-4970-8511-ef6f6356dc05 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1315 microversion: 2.1 time: 0.184533 Aug 08 02:33:58.089464 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 138/255] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:57 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:58.156673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:58.164602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:58.166102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:58.167995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a335ce67-997f-44d2-b5cf-43240ac862ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1408 microversion: 2.20 time: 0.194765 Aug 08 02:33:58.171937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 118/256] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:57 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:58.695602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:58.696229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:58.702633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:58.703110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:58.703728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:58.704443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:58.711659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:58.712109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:58.863821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:58.873202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-90e0af7f-682b-4a6b-917e-ab5d16f605b9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.181568 Aug 08 02:33:58.874278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 139/257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:58 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:59.110816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:59.112083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:59.118995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.120444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.121081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.122012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.122666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.123252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.197288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:59.199379 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:59.208168 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.208754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.209192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.210167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.210940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.211383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.374520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:59.383610 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:59.385067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:59.386886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-019b4406-1b24-4123-84a1-23ce3619bbd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1600 microversion: 2.20 time: 0.196091 Aug 08 02:33:59.394811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 140/258] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:33:59 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:33:59.409858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:59.410345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:59.416147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.417833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.418272 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.418987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.419467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.419885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.435075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:59.443351 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-42b984c5-38b4-4dd3-aef3-00c7f00435a7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1501 microversion: 2.1 time: 0.336863 Aug 08 02:33:59.452987 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 119/259] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:59 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:59.551415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-307f6241-9ddc-4304-bf61-ff0fafec16ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145400 Aug 08 02:33:59.552286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 141/260] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Aug 8 02:33:59 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:33:59.896264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:59.897718 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:59.909558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.910481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.911634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.913371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.914869 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.915533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:00.471632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:00.481179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e34ad039-3d67-4c2d-9591-2cf322337078 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.591518 Aug 08 02:34:00.481846 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 120/261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:59 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:01.162720 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-c7f320a0-efd6-408e-9501-06ac4159879e req-252ab14b-8137-4258-bd37-8913bc891120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:01.173217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c7f320a0-efd6-408e-9501-06ac4159879e req-252ab14b-8137-4258-bd37-8913bc891120 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:01.173992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c7f320a0-efd6-408e-9501-06ac4159879e req-252ab14b-8137-4258-bd37-8913bc891120 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:01.174547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c7f320a0-efd6-408e-9501-06ac4159879e req-252ab14b-8137-4258-bd37-8913bc891120 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:01.188725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-c7f320a0-efd6-408e-9501-06ac4159879e req-252ab14b-8137-4258-bd37-8913bc891120 service nova] Creating event network-changed:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:34:01.194872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-c7f320a0-efd6-408e-9501-06ac4159879e req-252ab14b-8137-4258-bd37-8913bc891120 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036308 Aug 08 02:34:01.195907 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 142/262] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:34:01.501747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:01.502898 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:01.512814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:01.518073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:01.523082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:01.523082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:01.523082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:01.523082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:01.743160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:01.751335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9b7e6455-92ea-4f1f-aa09-91d352b5f229 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.253331 Aug 08 02:34:01.751879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 121/263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:01 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:02.773417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:02.774115 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:02.781834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:02.782556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:02.782993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:02.783688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:02.784141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:02.784567 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:02.788991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:02.927630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:02.935788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bac7f2a8-04e9-439a-b7a7-31b28fd23be2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.166767 Aug 08 02:34:02.939934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 143/264] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:02 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:03.956141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:03.956764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:03.963614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:03.964357 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:03.964823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:03.965670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:03.966311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:03.966780 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:04.332395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:04.343000 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e66c9626-4b0e-42c2-b52c-ecfdd67e3b08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.390583 Aug 08 02:34:04.346565 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 122/265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:03 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:05.371496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:05.372818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:05.380945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:05.381462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:05.381909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:05.382791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:05.383483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:05.384114 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:05.679311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:05.687466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cfc1158c-878b-48c1-b0ae-fc598751784a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.321332 Aug 08 02:34:05.688346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 144/266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:05 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:06.717878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:06.717878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:06.724414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:06.726083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:06.729483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:06.731762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:06.732323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:06.734427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:07.049080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:07.059321 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d304fd16-594f-4838-a1fa-cd324e78ba30 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1322 microversion: 2.1 time: 0.354738 Aug 08 02:34:07.059875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 123/267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:06 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:07.932569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1808762-5d77-441c-8d26-281de1600fae"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:07.934924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:07.940770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:07.941240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:07.941916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:07.942742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:07.943284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:07.943775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.080647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:08.081253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:08.089576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.090061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.090519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.091209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.091652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.092073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.353737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:08.361985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f0f7624b-1f52-4c3a-ad28-67cf05da2390 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1514 microversion: 2.1 time: 0.284957 Aug 08 02:34:08.374729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 124/268] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:08 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:08.388356 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:08.391055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:08.398324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.399182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.399802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.401863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.402602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.403220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.467531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lazy-loading 'flavor' on Instance uuid b383010a-a42d-40bb-87aa-88500e694738 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:34:08.847470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-00c14f59-907a-49dd-99be-37f15d2454c8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738/action" status: 200 len: 32 microversion: 2.1 time: 0.458133 Aug 08 02:34:08.847470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 125/269] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:34:08 2022] POST /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738/action => generated 32 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:34:08.852919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-59178e6d-17da-4d8a-8d1b-ff83d1df0c53 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "POST /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923886 Aug 08 02:34:08.854533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 145/270] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:34:07 2022] POST /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:08.865866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:08.869414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:08.881280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.882184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.885248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.886615 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.887332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.887915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:09.162004 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:09.177291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94664785-1201-43d7-bf12-c63a1b6dfb52 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.328122 Aug 08 02:34:09.189166 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 126/271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:08 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:10.201408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:10.202241 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:10.216921 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:10.217727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:10.218375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:10.219592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:10.222691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:10.223392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:10.452242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:10.460908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-74436817-28b3-4321-b994-c27ce5f15a68 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.265361 Aug 08 02:34:10.461274 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 146/272] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:10 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:11.481946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:11.482589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:11.488521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:11.490757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:11.490757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:11.490757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:11.490757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:11.491060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:11.725534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:11.738517 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-207bd403-667a-44df-be93-9e130c07b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.261053 Aug 08 02:34:11.740927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 127/273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:11 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:12.768143 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:12.769301 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:12.777035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:12.777839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:12.778524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:12.779449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:12.779904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:12.780330 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:13.035767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:13.055933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7b9f4b57-2ae2-470b-ab0a-78fdba23b448 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.293545 Aug 08 02:34:13.058034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 147/274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:12 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:14.088912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:14.089419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:14.097211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:14.097890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:14.100092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:14.101385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:14.102026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:14.103197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:14.269194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:14.280124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3a9883ea-d3a3-4526-b152-80011c39cc22 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.206172 Aug 08 02:34:14.280800 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 128/275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:14 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:15.300922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:15.301740 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:15.315542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.317924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.318651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.323024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.323598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.324103 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.514534 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:15.530040 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c3e135c1-105b-44fe-9fc8-b78246338ae8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.232858 Aug 08 02:34:15.531159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 148/276] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:15 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:16.553110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:16.553769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:16.575175 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:16.575781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:16.576690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:16.577495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:16.578048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:16.578597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:16.822813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:16.831194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dd707de1-6610-4835-9698-579f397e8deb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.281986 Aug 08 02:34:16.832017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 129/277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:16 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:17.853574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:17.854265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:17.860477 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:17.860969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:17.861409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:17.862130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:17.863804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:17.863804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:18.090732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:18.153372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fdca1835-4448-4e9a-a958-86c4f08bb274 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.258210 Aug 08 02:34:18.153372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 149/278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:17 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:19.185961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:19.186571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:19.198085 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.198597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.199169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.199777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.200217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.200815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.479687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:19.488493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cbbd216f-88b3-4804-ba95-434a4d825bcb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.306520 Aug 08 02:34:19.489284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 130/279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:19 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:20.509938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:20.511580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:20.526797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:20.527571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:20.528188 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:20.529084 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:20.529720 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:20.530331 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:20.755784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:20.775797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5faec8e5-fa1d-447d-aef9-bc22bae219ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.265372 Aug 08 02:34:20.792649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 150/280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:20 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:21.804460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:21.805525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:21.820893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:21.821974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:21.823924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:21.824664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:21.825182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:21.825609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:21.849454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:21.999681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:22.009576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cbe5ac28-ef10-41a6-af78-19ab7001a6ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.212983 Aug 08 02:34:22.022802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 131/281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:21 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:23.031586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:23.032482 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:23.034703 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=44 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:23.040860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:23.040860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:23.041767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:23.041767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:23.042110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:23.043247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:23.225185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:23.233927 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-869fd1d4-1144-4165-83f3-ebc0c928667a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.206646 Aug 08 02:34:23.235963 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 151/282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:23 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:24.258830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:24.258830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:24.264368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:24.272205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:24.272681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:24.273507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:24.273907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:24.274329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:24.495400 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:24.504932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-43ca48b7-dd88-4be6-affa-bcd0b1355c5c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.253132 Aug 08 02:34:24.522009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 132/283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:24 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:25.526383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:25.526997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:25.534079 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:25.534833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:25.535556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:25.536756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:25.537218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:25.537639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:25.699531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:25.708488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bf91a518-ca74-4280-9a0f-2b0dd0f74aa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.185772 Aug 08 02:34:25.717870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 152/284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:25 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:26.732149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:26.732846 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:26.735267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=40 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:26.740553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:26.741042 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:26.742088 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:26.742996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:26.743633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:26.744058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:27.094860 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:27.103185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d41fd966-c785-46aa-9137-276aa4f1c716 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.376177 Aug 08 02:34:27.103770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 133/285] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:26 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:28.126718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:28.127156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:28.136127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:28.136651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:28.137143 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:28.137956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:28.138444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:28.139141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:28.144569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4b9d8a5a-6efd-4f83-a0fc-0ec540595d99 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Action: 'create', calling method: .version_select at 0x7fb2ba47aee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1610229995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0Z/n9Cw3c1wA/IhEW/hJ5nmpAGw7R6lCUbYgEXlDF+B8LQK4E6S4UBleP99i2FlwPIsHV20bLmjMSM9DURHwqblz3nw0fdTvyEmFUJZCh1axY0tT+AFddDWcoyFHShxA=="}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:28.160782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-4b9d8a5a-6efd-4f83-a0fc-0ec540595d99 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Getting quotas for project 31bdca178d874d499b1492305ad45a9c. Resources: {'key_pairs'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:34:28.164585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-4b9d8a5a-6efd-4f83-a0fc-0ec540595d99 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Getting quotas for user 747b60cf32a14b93bee399fce7a9b54b and project 31bdca178d874d499b1492305ad45a9c. Resources: {'key_pairs'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:34:28.272508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:28.281753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f3305ff-a378-4f09-b578-d2013fd1a69d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.161451 Aug 08 02:34:28.282327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 153/286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:28 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:28.321897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4b9d8a5a-6efd-4f83-a0fc-0ec540595d99 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.182787 Aug 08 02:34:28.323098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 134/287] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:34:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:34:28.446133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-46890651", "imageRef": "e7485151-f89b-42ce-8a84-5e95bf9c3e5d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1610229995", "networks": [{"uuid": "0039794c-6513-403c-9341-87684af30240"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:28.498718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] validate_networks() for [('0039794c-6513-403c-9341-87684af30240', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:34:28.925938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:34:28.926384 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:34:28.927159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:34:28.927881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:34:28.927983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:34:28.938139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:28.938647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:28.939075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:28.939795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:28.940241 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:28.940657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:28.960662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Getting quotas for project 31bdca178d874d499b1492305ad45a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:34:28.965561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Getting quotas for user 747b60cf32a14b93bee399fce7a9b54b and project 31bdca178d874d499b1492305ad45a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:34:28.978627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:34:28.981838 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7485151-f89b-42ce-8a84-5e95bf9c3e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:34:29.153808 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4932e80e-60f1-40d0-a73f-3aec2abf559a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711414 Aug 08 02:34:29.155272 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 154/288] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:34:29.173109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e5cff1b9-9173-4ded-a450-3c110249f0bd tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:29.174382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e5cff1b9-9173-4ded-a450-3c110249f0bd tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:29.236159 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e5cff1b9-9173-4ded-a450-3c110249f0bd tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:29.243570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e5cff1b9-9173-4ded-a450-3c110249f0bd tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1257 microversion: 2.1 time: 0.081810 Aug 08 02:34:29.244641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 135/289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:29 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:29.305825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:29.307157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:29.317877 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:29.318393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:29.318834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:29.319529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:29.320236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:29.321030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:29.472505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:29.482927 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-390b1d41-7fbd-4963-b670-224980707ee1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.180364 Aug 08 02:34:29.482927 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 155/290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:29 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:30.265577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c02935dd-083f-4c7c-94bb-78612976a4a0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:30.266732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c02935dd-083f-4c7c-94bb-78612976a4a0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:30.301872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:30.306014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:30.308340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:30.308948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:30.309321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:30.310174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:30.310773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:30.311190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:30.345162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c02935dd-083f-4c7c-94bb-78612976a4a0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:30.346483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:34:30.352190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c02935dd-083f-4c7c-94bb-78612976a4a0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1257 microversion: 2.1 time: 0.091031 Aug 08 02:34:30.353377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 136/291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:30 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1257 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:30.502664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:30.503272 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:30.509204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:30.511770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:30.511770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:30.511770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:30.511770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:30.512145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:30.674282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-52059b5b-86f6-48f6-995c-646372c76c7f tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 204 len: 0 microversion: 2.1 time: 0.372933 Aug 08 02:34:30.678869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 156/292] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:34:30 2022] DELETE /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:34:30.680187 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:30.689540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bb667c09-ff76-4cd2-a595-347ca60dc44f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.190822 Aug 08 02:34:30.690233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 137/293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:30 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:30.695178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:30.697092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:30.705447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:30.706474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:30.707318 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:30.708186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:30.708892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:30.709670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:30.732018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:30.881795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:30.891632 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ba67b171-1db8-4e77-aec1-02691c7cfc0c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1553 microversion: 2.1 time: 0.208879 Aug 08 02:34:30.892534 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 157/294] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:30 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:31.378614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:31.379250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:31.385135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:31.385610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:31.386036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:31.387606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:31.388207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:31.388823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:31.456064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:31.467548 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-91647119-f8e6-43b1-a561-54f64a6d6adc tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1253 microversion: 2.1 time: 0.092739 Aug 08 02:34:31.468419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 138/295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:31 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:31.714059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:31.715604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:31.724953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:31.725187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:31.725710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:31.726433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:31.727063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:31.727505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:31.883497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:31.891271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-472ac24c-2c89-4227-a495-b7ea3737e008 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.184010 Aug 08 02:34:31.891826 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 158/296] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:31 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:31.912937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:31.913599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:31.920374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:31.920863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:31.921301 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:31.922028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:31.922511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:31.922933 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.071590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:32.081363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-64cf18ec-33cb-4c85-95eb-a0894e6879cd tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1553 microversion: 2.1 time: 0.171968 Aug 08 02:34:32.082413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 139/297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:31 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:32.489336 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:32.489942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:32.499785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.500272 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.500784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.501483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.501930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.502375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.568190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:32.576299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a32df81a-4233-4222-aa19-ca3ccea9604f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1309 microversion: 2.1 time: 0.090944 Aug 08 02:34:32.576863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 159/298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:32 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:32.912783 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:32.913378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:32.919958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.920444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.921065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.921766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.922214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.922735 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.070556 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:33.078097 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1ac4d17b-3133-4542-b884-aa842f79dcaa tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.169160 Aug 08 02:34:33.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 140/299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:32 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:33.104919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:33.106901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:33.113484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.114159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.114772 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.117516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.117516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.117516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.286663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:33.295615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-374b51a6-2919-4313-8add-1412a14692d0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1553 microversion: 2.1 time: 0.194494 Aug 08 02:34:33.297010 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 160/300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:33 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:33.598795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:33.599859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:33.622498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.622995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.623433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.624139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.624622 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.631766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.714337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:33.722727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1ff39cf1-decf-4416-b176-2504dc746048 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1327 microversion: 2.1 time: 0.128354 Aug 08 02:34:33.723389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 141/301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:33 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:34.099481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:34.100453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:34.108325 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.112293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.112293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.112293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.112293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.112942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.291305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:34.307975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-05aa4be1-55d4-485e-8212-ca4d3e393344 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.212383 Aug 08 02:34:34.318473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 161/302] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:34 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:34.318925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:34.319441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:34.325758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.326343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.327078 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.327817 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.328328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.329217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.615289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:34.624196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a57fffb0-009a-4f78-a3f3-91d7d45861ff tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1553 microversion: 2.1 time: 0.310027 Aug 08 02:34:34.624786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 142/303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:34 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:34.762316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:34.762316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:34.773752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.775766 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.778991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.779925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.781233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.783126 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.801302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-5893b0e0-286e-4229-9eb2-81d86bb53100 req-ef318d5e-3f37-4fdb-9120-331e64441932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf3b2b7-8778-4f17-b615-2dad95f66ecb", "name": "network-vif-deleted", "tag": "75f505e8-1b29-4894-a1e1-92ef1e0c2996"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:34.834424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5893b0e0-286e-4229-9eb2-81d86bb53100 req-ef318d5e-3f37-4fdb-9120-331e64441932 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:34.835343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5893b0e0-286e-4229-9eb2-81d86bb53100 req-ef318d5e-3f37-4fdb-9120-331e64441932 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:34.836366 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5893b0e0-286e-4229-9eb2-81d86bb53100 req-ef318d5e-3f37-4fdb-9120-331e64441932 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:34.855659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-5893b0e0-286e-4229-9eb2-81d86bb53100 req-ef318d5e-3f37-4fdb-9120-331e64441932 service nova] Creating event network-vif-deleted:75f505e8-1b29-4894-a1e1-92ef1e0c2996 for instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb on hv-cinder-85226 Aug 08 02:34:34.863127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-5893b0e0-286e-4229-9eb2-81d86bb53100 req-ef318d5e-3f37-4fdb-9120-331e64441932 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068433 Aug 08 02:34:34.864207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 143/304] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:34:35.335140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:35.336775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:35.358767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:35.370038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:35.374402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:35.376784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:35.378462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:35.381782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:35.414447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:35.427466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-904db9b3-af86-4611-b167-efbaee451695 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.686163 Aug 08 02:34:35.428348 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 162/305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:34 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:35.645012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:35.645545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:35.653757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:35.654237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:35.654706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:35.655420 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:35.655928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:35.656739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:35.660524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:35.670141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2248406a-1667-45ce-a5fd-4497d5f3b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.340805 Aug 08 02:34:35.671787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 144/306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:35 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:35.778988 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:35.790196 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1f8d1b4a-856a-4f38-b354-958a1626f0e7 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.148792 Aug 08 02:34:35.791249 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 163/307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:35 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:36.449570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:36.450233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:36.456414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.458144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.458144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.458144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.458660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.459113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.623248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:36.633163 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-374c73a8-12b8-424a-a987-3273a4156f92 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.187969 Aug 08 02:34:36.646379 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 145/308] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:36 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:36.692565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:36.693167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:36.709183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.709594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.710029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.710770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.715428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.716998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.813080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:36.813692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:36.820449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.821431 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.822100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.823126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.824443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.825396 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.934521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:36.948372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c5e14e65-ca89-4ba4-9727-c9d593a6ac2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.260092 Aug 08 02:34:36.955337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 164/309] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:36 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:36.971222 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:36.982061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9a53535a-629e-4f39-b332-85199e842f6e tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.173415 Aug 08 02:34:37.013742 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 146/310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:36 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:37.655718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:37.656497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:37.662976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:37.663539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:37.664070 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:37.664946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:37.665468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:37.665898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:37.841737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:37.857075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-827543fa-7a00-4c2d-be42-756863f6a310 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.205484 Aug 08 02:34:37.858238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 165/311] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:37 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:37.987918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:37.995100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:38.005753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.008460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.008460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.008460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.011191 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.011852 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.015834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:38.016610 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:38.027625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.030150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.031295 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.032656 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.034174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.035460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.155285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:38.164229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a3fd1a1b-5ead-46d2-ae12-a2acd3f0af99 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.152145 Aug 08 02:34:38.170521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 166/312] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:38 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:38.512778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:38.526750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4f7e8b4f-bc91-4b7e-87cc-a52a4462a4a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.545353 Aug 08 02:34:38.529016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 147/313] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:37 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:38.880458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:38.881830 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:38.891591 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.892445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.892887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.895338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.898998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.898998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.983296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:38.984034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:39.191563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:39.192192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:39.203201 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:39.203965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:39.204633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:39.205493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:39.206709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:39.207289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:39.495503 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:39.505461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-732a5f5c-6e45-4db8-b595-96c0dc7d1c15 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.629308 Aug 08 02:34:39.512334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 167/314] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:38 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:39.555709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:39.576377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:39.601236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:39.601862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:39.602318 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:39.603810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:39.604282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:39.605131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:39.629560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:39.647992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9775a428-9ce0-40d8-aa6c-e5449e899dc2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.461344 Aug 08 02:34:39.649055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 148/315] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:39 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:39.831496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:39.840901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cb5079bd-e8c3-4923-a007-988a9b16761d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.293983 Aug 08 02:34:39.841486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 168/316] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:39 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:40.534346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:40.586240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:40.586240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=8 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:40.586240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.586240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.586684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.586684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.586684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.586684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.670679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:40.671474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:40.678024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.678894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.679484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.680368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.680976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.681650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.737959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:40.752506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-57d6a37f-427e-4cbb-8bac-2acce4e92a75 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.222399 Aug 08 02:34:40.753478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 149/317] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:40 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:40.763777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:40.774064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6cc25bba-4a2e-485c-b9d1-2d566bb17bb0 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.108547 Aug 08 02:34:40.774631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 169/318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:40 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:40.862540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:40.863150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:40.869704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.871239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.871913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.872834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.873490 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.874134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:41.046676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:41.055741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ee22916e-69f9-4aa8-8cea-cbc6a63c7143 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.196524 Aug 08 02:34:41.056039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 150/319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:40 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:41.773201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:41.773839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:41.781091 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:41.781597 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:41.782042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:41.782801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:41.783451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:41.783960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:41.798069 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:41.798792 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:41.804925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:41.805455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:41.805885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:41.806772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:41.807218 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:41.807781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:41.908049 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:41.918424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:41.925009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e7c4c800-91fd-4193-801a-64455649e6a9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.131219 Aug 08 02:34:41.930193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 151/320] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:41 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:41.949756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:41.960778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5f952cbd-6fe3-4800-901b-a27eb5de9486 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.191119 Aug 08 02:34:41.962734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 170/321] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:41 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:42.087135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:42.090787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:42.113302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:42.117525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:42.118176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:42.122197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:42.123978 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:42.126718 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:42.401564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:42.401564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-498069b5-9f3a-4bb8-812e-bf005782c260 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.299488 Aug 08 02:34:42.401564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 152/322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:42 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:42.957222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:42.958622 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:42.966374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:42.967284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:42.967946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:42.968897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:42.969575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:42.970072 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:42.991226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:42.991793 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:42.999777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.000306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.000727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.001604 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.002044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.002733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.110557 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:43.120840 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c22f8350-8111-47d3-b0f0-53e35d66c082 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.166182 Aug 08 02:34:43.121971 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 171/323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:42 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:43.222103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:43.230404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-abea66c5-01c5-45c0-a64d-8373e063c6df tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.252242 Aug 08 02:34:43.231277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 153/324] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:42 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:43.398446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:43.399087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:43.405823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.406308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.407161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.408660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.409132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.409566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.590448 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:43.600660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-362d7fd7-f946-4b20-9981-dcc5282f6c9a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.208447 Aug 08 02:34:43.601278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 172/325] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:43 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:44.143746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:44.144596 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:44.150608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.151087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.151567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.153523 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.153969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.154465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.223370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:44.230081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-05dd7066-7bc1-410b-bdd4-a8ec5c8aff92 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.090943 Aug 08 02:34:44.230704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 154/326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:44 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:44.252884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:44.253531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:44.259802 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.260275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.260762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.262319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.263367 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.263799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.396197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:44.404104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0032cfd8-1ab4-482d-995c-881affc3a5ce tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.155021 Aug 08 02:34:44.404654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 173/327] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:44 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:44.622717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:44.623242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:44.629101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.629573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.629998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.630704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.631147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.631559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.760744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:44.769350 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d96bc55a-2267-4134-a913-b1888e21dc71 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.151827 Aug 08 02:34:44.769916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 155/328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:44 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:45.251142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:45.251747 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:45.258035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.261944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.261944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.261944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.261944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.262858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.265185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:45.330928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:45.339014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ddaf8119-75e7-42fb-b93d-53185247e11d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.091612 Aug 08 02:34:45.339593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 174/329] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:45 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:45.424714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:45.425156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:45.432114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.433782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.433782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.434620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.435086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.435422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.569084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:45.578145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-24b4983b-9681-4854-97b1-473e48c86a9d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.157482 Aug 08 02:34:45.578737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 156/330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:45 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:45.789851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:45.790507 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:45.797127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.797619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.798061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.798784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.799265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.799697 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.940453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:45.947920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bc275c83-d760-4cc8-a547-38bd9dc77d08 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.161812 Aug 08 02:34:45.948521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 175/331] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:45 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:46.361063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:46.361665 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:46.367587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.368060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.368497 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.369160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.369610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.370021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.435285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:46.443207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-86a7b6e5-ed3a-489d-9f16-9ac3269174ab tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.085960 Aug 08 02:34:46.443819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 157/332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:46 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:46.599083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:46.599757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:46.606168 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.606679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.607117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.607807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.608257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.608686 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.740780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:46.748147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-01b78b4f-ba19-4071-b397-5e4a1edfe39e tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.152962 Aug 08 02:34:46.748705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 176/333] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:46 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:46.969902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:46.970568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:46.986649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.987106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.987530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.988231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.988681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.989249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:47.126048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:47.133546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-419d3d8b-3654-46a3-b139-0c8dd7984f1d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.167553 Aug 08 02:34:47.134112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 158/334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:46 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:47.464667 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:47.465190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:47.471044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:47.471512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:47.471942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:47.472646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:47.473093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:47.473510 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:47.538269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:47.547044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fccf657f-1b74-4ae9-b6a5-a6ae6e4f5f95 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.086332 Aug 08 02:34:47.547594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 177/335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:47 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:47.768941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:47.769510 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:47.775469 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:47.775946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:47.776376 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:47.777652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:47.778102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:47.778552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:47.918424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:47.926051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e7d0c6c7-9ac7-4690-8190-31fc1f83b822 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.160947 Aug 08 02:34:47.926790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 159/336] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:47 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:48.155366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:48.156092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:48.165487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:48.166102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:48.166579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:48.168752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:48.168752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:48.169194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:48.333798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:48.343305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-80617d0d-fc94-4cd2-8f7e-fbc25c6065d5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.192591 Aug 08 02:34:48.344417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 178/337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:48 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:48.568813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:48.569465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:48.576139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:48.585209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:48.585209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:48.585209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:48.585209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:48.585695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:48.652213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:48.664703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5f79120a-7aad-4280-9009-9484da316a48 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.100403 Aug 08 02:34:48.665151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 160/338] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:48 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:48.946051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:48.946695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:48.953118 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:48.953598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:48.954039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:48.954757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:48.955211 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:48.955910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.082463 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:49.089880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47003b7f-58a7-4fce-8b1c-a2b2113cc6b9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.147743 Aug 08 02:34:49.090455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 179/339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:48 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:49.364916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:49.365515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:49.371881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:49.372344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:49.372764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.373433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:49.373922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:49.374285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.505892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:49.513590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-55e848ec-de82-4a09-8e7e-b04dd9978652 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.152496 Aug 08 02:34:49.514147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 161/340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:49 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:49.687453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:49.688012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:49.694439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:49.694910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:49.695339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.696012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:49.696460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:49.696880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.762965 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:49.770947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f58c04a-3668-4491-a1be-75ae7368f6a4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.088080 Aug 08 02:34:49.771504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 180/341] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:49 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:50.111211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:50.111810 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:50.117670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.118136 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.118607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.119275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.119717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.120126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.248841 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:50.256305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f18bcab4-bbcc-4812-ba19-35991422c714 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.148896 Aug 08 02:34:50.256855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 162/342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:50 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:50.534440 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:50.535067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:50.540960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.541435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.541865 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.542728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.542728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.543478 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.672876 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:50.680291 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c2fbb800-0ff1-47d3-833c-d697e0943243 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.149947 Aug 08 02:34:50.682416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 181/343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:50 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:50.791801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:50.792410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:50.798524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.799002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.799429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.800106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.800554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.800969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.864413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:50.873073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d847eee4-02c9-486f-8f70-3ef92d23373a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1511 microversion: 2.1 time: 0.085112 Aug 08 02:34:50.873641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 163/344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:50 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:51.278158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:51.278944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:51.285030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.285533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.285963 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.286679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.287130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.287547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.415405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:51.423474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0831530b-ad68-4ebb-b3a9-1c5b790797b1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.150420 Aug 08 02:34:51.424054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 182/345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:51 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:51.701685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:51.702924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:51.709234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.709705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.710131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.710889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.711331 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.711748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.893516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:51.894544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:51.900562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.901048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.901489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.902195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.902689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.903171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.906135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:51.913888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1d0d5fbc-2a41-4cd2-9a4b-3912cb1480a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.216558 Aug 08 02:34:51.922174 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 164/346] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:51 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:51.982008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:52.000159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-34826ba5-4012-4bd4-8c80-7492d12eaa5d tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.110460 Aug 08 02:34:52.000912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 183/347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:51 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:52.444884 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:52.447616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:52.451942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.452521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.453167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:52.453886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.454522 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.454931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:52.641344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:52.648726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f9ee3f0c-1243-4a48-947b-3d16cca30cb9 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.208221 Aug 08 02:34:52.649281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 165/348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:52 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:52.709875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-7c51d4ab-8ef1-4091-b9b7-b5d374c409b4 req-7d8842d0-8388-44fa-935c-1709d0751bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:52.719930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7c51d4ab-8ef1-4091-b9b7-b5d374c409b4 req-7d8842d0-8388-44fa-935c-1709d0751bf7 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.720403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7c51d4ab-8ef1-4091-b9b7-b5d374c409b4 req-7d8842d0-8388-44fa-935c-1709d0751bf7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.720835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7c51d4ab-8ef1-4091-b9b7-b5d374c409b4 req-7d8842d0-8388-44fa-935c-1709d0751bf7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:52.732611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-7c51d4ab-8ef1-4091-b9b7-b5d374c409b4 req-7d8842d0-8388-44fa-935c-1709d0751bf7 service nova] Creating event network-changed:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:34:52.737582 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-7c51d4ab-8ef1-4091-b9b7-b5d374c409b4 req-7d8842d0-8388-44fa-935c-1709d0751bf7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031727 Aug 08 02:34:52.738308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 184/349] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:52.934690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:52.935303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:52.941139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.941614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.942043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:52.942754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.943203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.943622 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.021418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:53.022190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:53.029437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.029925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.030373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.031100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.031736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.032181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.072871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:53.081232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7eb57acb-4e5d-4c54-bc25-0ee765476788 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.150120 Aug 08 02:34:53.082343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 166/350] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:52 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:53.097896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:53.107069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fdeccb94-b099-4d74-96c7-0bc60ab293f9 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.089612 Aug 08 02:34:53.107519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 185/351] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:53 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:53.669741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:53.670269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:53.676144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.676613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.677038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.677705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.678163 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.678584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.806228 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:53.814376 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e472fd23-3c0d-4f5d-85ab-3519d72b12da tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.149118 Aug 08 02:34:53.814933 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 167/352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:53 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:54.102702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:54.103312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:54.110222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.110729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.111164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.111880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.112331 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.112753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.127521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:54.128125 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:54.134072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.134580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.135013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.135696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.136229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.137043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.159207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:54.254980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:54.262966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a0d1fe87-fe95-4ad9-8172-153c58aa84a3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.163993 Aug 08 02:34:54.263584 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 186/353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:54 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:54.337077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:54.345744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bb4fa102-2718-46db-bf23-3ecff18c45d2 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.222019 Aug 08 02:34:54.346298 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 168/354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:54 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:54.836014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:54.836658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:54.843261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.843739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.844174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.844856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.845313 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.845736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.975643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:54.982970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-393639bf-bd6a-420e-b486-c28eafe2104f tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.150892 Aug 08 02:34:54.983529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 187/355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:54 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:55.283015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:55.283621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:55.289483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:55.289954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:55.290416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:55.291092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:55.291539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:55.291956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:55.366325 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:55.367313 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:55.373987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:55.374488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:55.374937 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:55.375631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:55.376081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:55.376508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:55.420384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:55.428145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3294a552-2233-450a-adca-5908ca1c45d9 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.148969 Aug 08 02:34:55.428906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 169/356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:55 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:55.439696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:55.447689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b5171094-9586-4f3c-8857-102c1c4f1f6a tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.085198 Aug 08 02:34:55.448255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 188/357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:55 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:56.007508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:56.008598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:56.016627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:56.017176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:56.019055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:56.019055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:56.019055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:56.019353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:56.373786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:56.380959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9d1598db-5c0a-4629-879f-dac0572066e6 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.380741 Aug 08 02:34:56.381513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 170/358] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:55 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:56.449638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:56.450258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:56.452716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:56.457813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:56.458292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:56.458755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:56.459452 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:56.459913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:56.460334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:56.469735 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:56.470141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:56.476977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:56.477552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:56.478050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:56.478892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:56.479503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:56.480933 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:56.611093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:56.618536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-da375553-42cf-4e08-9225-623cea5ecc51 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.173362 Aug 08 02:34:56.619099 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 189/359] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:56 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:56.640414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:56.648340 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-748599bc-ff34-40d4-aec2-5b1c464743e4 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.184428 Aug 08 02:34:56.648900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 171/360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:56 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:57.402597 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:57.403215 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:57.409458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:57.409942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:57.410422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:57.411116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:57.414992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:57.414992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:57.550240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:57.561936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-92992417-ef28-4ada-a8a8-c3869e643435 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.163182 Aug 08 02:34:57.567188 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 190/361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:57 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:57.640870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:57.641552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:57.648265 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:57.648876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:57.649314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:57.650011 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:57.650695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:57.651211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:57.670867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:57.672097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:57.679106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:57.679880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:57.680528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:57.681383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:57.681989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:57.682664 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:57.707472 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:57.750829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:57.759431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-21d3352a-c966-424f-8a33-643b4dae1212 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.093712 Aug 08 02:34:57.759995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 191/362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:57 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:34:57.845935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:57.853555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5cdf6634-35ba-49a6-bbfe-4e8bd64ef760 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.218071 Aug 08 02:34:57.854113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 172/363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:57 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:58.584529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:58.585144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:58.593310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:58.593808 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:58.594217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:58.594961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:58.595455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:58.595826 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:58.727067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:58.734523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9f16f09b-6876-42f1-8790-2e4ffa7a9ea3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.154755 Aug 08 02:34:58.735173 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 192/364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:58 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:58.780539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:58.781165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:58.783082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:58.787919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:58.788403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:58.788843 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:58.789561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:58.790018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:58.790472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:58.858046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:58.874302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:58.874542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1b5e2ac7-8c6b-4f1e-ba36-b75a3073d031 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.098064 Aug 08 02:34:58.875099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 173/365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:58 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:58.882498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:58.882498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:58.882498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:58.883040 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:58.883809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:58.884396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:58.884891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:59.030741 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:59.038104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9fd447cc-0f12-4edb-9a79-e2240a63b9b7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.168279 Aug 08 02:34:59.038698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 193/366] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:58 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:59.758762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:59.759527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:59.767327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:59.768264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:59.768694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:59.769429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:59.769877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:59.770287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:59.896160 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:59.896777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:59.903475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:59.904742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:59.904742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:59.905124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:59.905584 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:59.906011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:59.909913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:59.917447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0512aeb4-bb65-49eb-b279-ae0e4dd29f16 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.165315 Aug 08 02:34:59.918547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 174/367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:59 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:59.972455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:59.980528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ea33de6-5b6e-4348-9477-eebf04521008 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.088247 Aug 08 02:34:59.981596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 194/368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:59 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:00.058830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:00.060284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:00.066380 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:00.066871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:00.067294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:00.067980 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:00.068425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:00.068839 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:00.201781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:00.209652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9c34bf4f-a44e-43b9-bad5-2f1e3872cc2c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.154677 Aug 08 02:35:00.210212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 175/369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:00 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:00.939738 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:00.940973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:00.948523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:00.949006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:00.949512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:00.950964 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:00.951416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:00.951969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:01.004772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:01.005414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:01.011958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:01.013027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:01.013640 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:01.014532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:01.014984 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:01.015409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:01.100165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd725e4cb658b43438c1f22a80b1dc5ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce575522168344caacf13cfc7779e25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:01.101945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5564eef0-f5e0-4352-a820-fd20f61800eb tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 200 len: 1346 microversion: 2.1 time: 0.102132 Aug 08 02:35:01.102580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 176/370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:00 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:01.145876 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:01.153598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f045ab07-79a9-4dd0-ace4-a1803aae2b0c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.218124 Aug 08 02:35:01.158092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 195/371] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:00 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:01.231026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:01.231911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:01.237977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:01.238510 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:01.244008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:01.244008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:01.244008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:01.244008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:01.417892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:01.426494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-15e8db62-518d-408d-a8d0-c014fcbebc29 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.199244 Aug 08 02:35:01.427062 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 177/372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:01 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:02.123832 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:02.124421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:02.132659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.134641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.134641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.134962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.135557 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.136281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.154891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] HTTP exception thrown: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Request method failure captured: Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb HTTP/1.1 Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW4KkqIHcJWXep-FRKo_cZo-JMHijN-aG6S6Nt9QsQzy3whLaDNpKH916ESdF_jVxbL2Qe4GTnYZKJ-Odci3WSP0K_VE-hUdaGcL6ntG-oM-WaEXbvfstLpRxt5iKD-IL5XVHOis6QRPFcp3WihcpJThM2r---TEKfEFnt2O7hQZUg Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:35:02.161797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce575522168344caacf13cfc7779e25b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce575522168344caacf13cfc7779e25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: d725e4cb658b43438c1f22a80b1dc5ad Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.165635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bcf3b2b7-8778-4f17-b615-2dad95f66ecb'} Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:35:02.166581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.167962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.169750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Returning 404 to user: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:35:02.169750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b23e2e92-91a5-4df7-ba69-7f7c432ac888 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 404 len: 111 microversion: 2.1 time: 0.044843 Aug 08 02:35:02.170756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 196/373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:02 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:02.182390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:02.185197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:02.198225 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.198834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.200673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.203688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.204235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.205344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.314839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:02.318005 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:02.325377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.326256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.326876 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.327904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.328618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.329466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.348794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] HTTP exception thrown: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Request method failure captured: Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb/os-volume_attachments HTTP/1.1 Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW4KkqIHcJWXep-FRKo_cZo-JMHijN-aG6S6Nt9QsQzy3whLaDNpKH916ESdF_jVxbL2Qe4GTnYZKJ-Odci3WSP0K_VE-hUdaGcL6ntG-oM-WaEXbvfstLpRxt5iKD-IL5XVHOis6QRPFcp3WihcpJThM2r---TEKfEFnt2O7hQZUg Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:35:02.351457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce575522168344caacf13cfc7779e25b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce575522168344caacf13cfc7779e25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: d725e4cb658b43438c1f22a80b1dc5ad Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.352828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'server_id': 'bcf3b2b7-8778-4f17-b615-2dad95f66ecb'} Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:35:02.353829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:02.355302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:02.359385 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Returning 404 to user: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:35:02.360453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2732b553-1839-47fa-a942-445be365d978 tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051769 Aug 08 02:35:02.361523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 197/374] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:35:02 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:02.375279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:02.383001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-882cb924-84a2-49fe-b055-757ac2974563 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.206774 Aug 08 02:35:02.383499 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 178/375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:02 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:02.448857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:02.450265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:02.457505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.458049 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.458619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.459560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:02.460020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:02.460609 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:02.628547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:02.637918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-54ac1d38-1b27-4b01-8c75-a7a6b11a3645 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.194070 Aug 08 02:35:02.639050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 198/376] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:02 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:03.409306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:03.410091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:03.423203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.426760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.426760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.426760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.426760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.427108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.599211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:03.607196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e5ecc4ea-fcf4-4f89-be2e-147f5e03c154 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.206794 Aug 08 02:35:03.607865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 179/377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:03 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:03.665946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:03.665946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:03.668155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.669446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.669944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.671072 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.671228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.671753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.813220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:03.813893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:03.821562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.821562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.821562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.821834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.822260 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.822699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.837437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] HTTP exception thrown: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Request method failure captured: Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: DELETE /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb HTTP/1.1 Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW4KkqIHcJWXep-FRKo_cZo-JMHijN-aG6S6Nt9QsQzy3whLaDNpKH916ESdF_jVxbL2Qe4GTnYZKJ-Odci3WSP0K_VE-hUdaGcL6ntG-oM-WaEXbvfstLpRxt5iKD-IL5XVHOis6QRPFcp3WihcpJThM2r---TEKfEFnt2O7hQZUg Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:35:03.843141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce575522168344caacf13cfc7779e25b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce575522168344caacf13cfc7779e25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: d725e4cb658b43438c1f22a80b1dc5ad Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.845749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'bcf3b2b7-8778-4f17-b615-2dad95f66ecb'} Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:35:03.846609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.847906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.849213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Returning 404 to user: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:35:03.849213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2c37d206-dc6f-492a-a834-6ac90417751b tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 404 len: 111 microversion: 2.1 time: 0.035932 Aug 08 02:35:03.849213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 180/378] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:35:03 2022] DELETE /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:35:03.852714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:03.853328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] [instance: bcf3b2b7-8778-4f17-b615-2dad95f66ecb] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:03.859767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.860424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.860971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.861662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:03.862110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:03.862567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:03.881772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] HTTP exception thrown: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.881891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Request method failure captured: Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb HTTP/1.1 Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW4KkqIHcJWXep-FRKo_cZo-JMHijN-aG6S6Nt9QsQzy3whLaDNpKH916ESdF_jVxbL2Qe4GTnYZKJ-Odci3WSP0K_VE-hUdaGcL6ntG-oM-WaEXbvfstLpRxt5iKD-IL5XVHOis6QRPFcp3WihcpJThM2r---TEKfEFnt2O7hQZUg Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:35:03.884659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce575522168344caacf13cfc7779e25b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce575522168344caacf13cfc7779e25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce575522168344caacf13cfc7779e25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: ce575522168344caacf13cfc7779e25b Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-DeleteServersTestJSON-2098427827 Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: d725e4cb658b43438c1f22a80b1dc5ad Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-DeleteServersTestJSON-2098427827-project Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.891521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'bcf3b2b7-8778-4f17-b615-2dad95f66ecb'} Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:35:03.892527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. Aug 08 02:35:03.893848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:35:03.895290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] Returning 404 to user: Instance bcf3b2b7-8778-4f17-b615-2dad95f66ecb could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:35:03.895290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1883d488-23ac-4e0f-a2dc-bcca77cb043c tempest-DeleteServersTestJSON-2098427827 tempest-DeleteServersTestJSON-2098427827-project] 10.222.0.15 "GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb" status: 404 len: 111 microversion: 2.1 time: 0.037050 Aug 08 02:35:03.895290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 181/379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:03 2022] GET /compute/v2.1/servers/bcf3b2b7-8778-4f17-b615-2dad95f66ecb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:35:03.895531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a4d1cc24-54e8-4a41-b5c7-21900b0c1665 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.235959 Aug 08 02:35:03.895531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 199/380] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:03 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:04.491641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-3729ea07-478c-41f7-8172-08b52f98e2a4 req-6f1c9e65-cbfc-42db-817f-db038ce37d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "name": "network-vif-plugged", "status": "completed", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:04.504791 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3729ea07-478c-41f7-8172-08b52f98e2a4 req-6f1c9e65-cbfc-42db-817f-db038ce37d2c service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:04.505617 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3729ea07-478c-41f7-8172-08b52f98e2a4 req-6f1c9e65-cbfc-42db-817f-db038ce37d2c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:04.506084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3729ea07-478c-41f7-8172-08b52f98e2a4 req-6f1c9e65-cbfc-42db-817f-db038ce37d2c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:04.519463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-3729ea07-478c-41f7-8172-08b52f98e2a4 req-6f1c9e65-cbfc-42db-817f-db038ce37d2c service nova] Creating event network-vif-plugged:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:35:04.525714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-3729ea07-478c-41f7-8172-08b52f98e2a4 req-6f1c9e65-cbfc-42db-817f-db038ce37d2c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Aug 08 02:35:04.526552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 182/381] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:04.628542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:04.629233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:04.641247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:04.641735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:04.642172 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:04.642896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:04.643379 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:04.643796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:04.814112 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:04.823356 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4d464128-9869-4d21-a3f1-b9169230101c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.198588 Aug 08 02:35:04.823932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 200/382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:04 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:04.917452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:04.921312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:04.928099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:04.929543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:04.931054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:04.931973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:04.932608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:04.933281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:05.167109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:05.176317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b66f2e37-468f-4920-a5ed-3b4dba1c71eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1520 microversion: 2.1 time: 0.264846 Aug 08 02:35:05.177383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 183/383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:04 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:05.845258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:05.847045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:05.854265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:05.855155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:05.856253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:05.859050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:05.859523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:05.860194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:06.198225 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:06.200608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:06.203193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:06.209171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:06.210823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:06.211811 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:06.213187 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:06.214014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:06.214972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:06.224351 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2c249cd5-a646-4028-b9da-6bb450a34b6a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.383586 Aug 08 02:35:06.225671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 201/384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:05 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:06.633143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:06.642172 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-14db8718-dce9-4ca7-b1dc-57fd546f1cca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1500 microversion: 2.1 time: 0.448964 Aug 08 02:35:06.643390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 184/385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:06 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1500 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:06.665734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:06.666615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:06.674304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:06.675104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:06.675727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:06.676767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:06.677715 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:06.678304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:06.833095 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:06.845042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bf27ad42-f56f-40e2-8da7-ad5100bb157d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1514 microversion: 2.1 time: 0.185226 Aug 08 02:35:06.845905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 202/386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:06 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:07.247192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:07.248052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:07.257323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:07.259059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:07.259711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:07.264678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:07.265258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:07.266111 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:07.522884 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:07.543488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1e045565-5ca1-4419-ba3a-75f1a4d4d046 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1357 microversion: 2.1 time: 0.300890 Aug 08 02:35:07.544757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 185/387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:07 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:08.571221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:08.571870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:08.582068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:08.582587 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:08.597944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:08.605335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:08.611534 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:08.613894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:08.997300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-594009436", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "networks": [{"uuid": "235dc6e2-4294-4f34-bc7f-a3769150961e"}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:09.095977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] validate_networks() for [('235dc6e2-4294-4f34-bc7f-a3769150961e', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:35:09.142636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:09.150623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9dd53951-7f73-4ad5-b6a8-1e37e4fd911c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1546 microversion: 2.1 time: 0.583206 Aug 08 02:35:09.151458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 203/388] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:08 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1546 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:09.187059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:09.188032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:09.195842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.196367 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.197010 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.197968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.198607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.199835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.515094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:35:09.515822 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:35:09.516320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:35:09.516726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:35:09.517133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:35:09.526983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.527194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.528249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.529014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.529460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.529884 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.550530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Getting quotas for project 5ec7a76094c54d6c8e2517e254f44c16. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:35:09.554626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Getting quotas for user f67323f672464220a38906660715a9d6 and project 5ec7a76094c54d6c8e2517e254f44c16. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:35:09.566629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:35:09.568883 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:35:09.677617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:09.688735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b7b1ddb7-f2dc-4e36-8c5a-4612d57958c3 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1546 microversion: 2.1 time: 0.516560 Aug 08 02:35:09.689962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 204/389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:09 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1546 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:09.695472 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:09.698158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:09.704621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.705361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.706082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.707205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.707879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.708705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.741624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lazy-loading 'flavor' on Instance uuid 4449d47c-fbac-4e23-8017-0a283a5ba7d9 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:35:09.803165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d7738ccf-75d6-42d1-82c6-5da9bd74b406 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816375 Aug 08 02:35:09.814725 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 186/390] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:35:09.827582 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:09.835810 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:09.836573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Searching by: {'deleted': False, 'project_id': '31bdca178d874d499b1492305ad45a9c'} {{(pid=124658) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 02:35:09.857428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.857428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.857428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.857428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:09.857875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:09.857875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:09.973906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.multi_cell_list [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124658) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 02:35:10.048448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:10.101459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-52c399e0-4bfe-49a5-a923-6127e5f7b26c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.285571 Aug 08 02:35:10.102038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 187/391] 10.222.0.15 () {58 vars in 1125 bytes} [Mon Aug 8 02:35:09 2022] GET /compute/v2.1/servers => generated 341 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:10.107602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7c6eb708-2c24-447d-8547-6b15c107815d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:10.108203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7c6eb708-2c24-447d-8547-6b15c107815d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:10.163941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7c6eb708-2c24-447d-8547-6b15c107815d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:10.171433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7c6eb708-2c24-447d-8547-6b15c107815d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1218 microversion: 2.1 time: 0.068390 Aug 08 02:35:10.171981 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 188/392] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:10 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:10.176631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:10.177444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:10.185405 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:10.185892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:10.186318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:10.187039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:10.187488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:10.187908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:10.205206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1a75422b-ce24-4ad4-90b5-28cd0a5c19c5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/action" status: 200 len: 32 microversion: 2.1 time: 0.513169 Aug 08 02:35:10.206101 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 205/393] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:35:09 2022] POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:35:10.219214 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:10.220107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:10.228976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:10.229465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:10.232038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:10.232038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:10.232038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:10.232432 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:10.326978 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:10.338748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1b86edff-7c67-499b-832d-fd2370e2dd28 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1546 microversion: 2.1 time: 0.165259 Aug 08 02:35:10.339332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 189/394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:10 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:10.415527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:10.426465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1fa04c8b-5a6e-42e9-8ad5-a1a5106e7697 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.213584 Aug 08 02:35:10.427420 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 206/395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:10 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:11.195035 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:11.195979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:11.202787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:11.203517 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:11.203901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:11.205007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:11.205598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:11.206017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:11.287706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:11.302703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9a23be6f-0baa-46d1-bc9d-d2c288b1ef16 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1222 microversion: 2.1 time: 0.114420 Aug 08 02:35:11.303686 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 190/396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:11 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:11.449403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:11.449403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:11.455445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:11.455930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:11.456371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:11.457077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:11.457530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:11.458018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:11.477354 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:11.608395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:11.615984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cd32e963-5358-4d30-92db-a7bd0441d894 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.172434 Aug 08 02:35:11.619562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 207/397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:11 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:12.327748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:12.328360 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:12.334790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:12.338274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:12.338274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:12.338274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:12.338274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:12.338768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:12.447563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:12.454174 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c61845bb-99d0-47bc-9634-71a913f9233b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1270 microversion: 2.1 time: 0.130115 Aug 08 02:35:12.455597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 191/398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:12 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:12.549286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cb8c9af-e316-4ccd-a7f8-e0859dc6131b"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:12.554123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:12.567581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:12.568356 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:12.568875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:12.569737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:12.570193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:12.570683 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:12.642949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:12.643720 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:12.651369 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:12.653625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:12.654962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:12.656190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:12.657102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:12.657967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:12.857547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:12.865735 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-996644c8-9c9d-4bcc-8d81-37f909c5fb99 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.232234 Aug 08 02:35:12.866229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 192/399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:12 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:13.479027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:13.486550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:13.489655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:13.490492 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:13.491235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:13.492289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:13.492949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:13.493707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:13.563147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:13.571166 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-21158db6-011b-4252-8070-3d1f7ae356bc tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1276 microversion: 2.1 time: 0.097592 Aug 08 02:35:13.571995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 193/400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:13 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:13.887262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:13.888124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:13.894271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:13.894822 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:13.895294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:13.895968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:13.896418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:13.896836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:14.142054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:14.150237 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0384608f-0f6d-4d39-8117-275bcea8a094 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.266879 Aug 08 02:35:14.150855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 194/401] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:13 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:14.209416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ad1f039f-ada2-492d-996d-0db7757a856d tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.666404 Aug 08 02:35:14.210217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 208/402] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:35:12 2022] POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments => generated 194 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:14.593486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:14.594253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:14.600506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:14.600999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:14.601433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:14.602130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:14.602815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:14.603422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:14.753696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:14.786623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ace847f4-0391-4159-b755-44d2b5ae4316 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.197589 Aug 08 02:35:14.799167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 195/403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:14 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:15.177644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:15.178387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:15.184507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-2d51fd82-4b97-4368-a9f5-345e375149cc req-8ea06f1d-aef5-42fc-a9c3-1cb56729a97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998bc6f6-7f4e-4219-ba48-4d047531c55c", "tag": "06ece2e5-1c70-462c-91bf-e4c9507cc4d4"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:15.189684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:15.190967 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:15.191597 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:15.193356 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:15.194203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:15.195843 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:15.205881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-2d51fd82-4b97-4368-a9f5-345e375149cc req-8ea06f1d-aef5-42fc-a9c3-1cb56729a97d service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:15.206797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-2d51fd82-4b97-4368-a9f5-345e375149cc req-8ea06f1d-aef5-42fc-a9c3-1cb56729a97d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:15.207506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-2d51fd82-4b97-4368-a9f5-345e375149cc req-8ea06f1d-aef5-42fc-a9c3-1cb56729a97d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:15.227744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-2d51fd82-4b97-4368-a9f5-345e375149cc req-8ea06f1d-aef5-42fc-a9c3-1cb56729a97d service nova] Creating event network-changed:06ece2e5-1c70-462c-91bf-e4c9507cc4d4 for instance 998bc6f6-7f4e-4219-ba48-4d047531c55c on hv-cinder-85226 Aug 08 02:35:15.235123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-2d51fd82-4b97-4368-a9f5-345e375149cc req-8ea06f1d-aef5-42fc-a9c3-1cb56729a97d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054987 Aug 08 02:35:15.242020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 196/404] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:35:15.626069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:15.644913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2b153150-970b-4ec5-a597-422e8887d7a1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.473686 Aug 08 02:35:15.665512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 209/405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:15 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:15.811614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:15.814691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:15.823405 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:15.825226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:15.826276 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:15.828095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:15.828754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:15.829491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:16.091889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:16.114678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-51a2db9a-0ba4-41f1-a5d2-f50a29658c46 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.308743 Aug 08 02:35:16.118297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 197/406] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:15 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:16.675425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:16.676110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:16.710793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:16.724260 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:16.724659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:16.725408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:16.725860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:16.726284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:17.048625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:17.056083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-24f25323-736f-4679-924c-0e4ce2ff2c56 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.391807 Aug 08 02:35:17.056653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 210/407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:16 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:17.136988 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:17.142091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:17.144588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:17.145250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:17.145679 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:17.146704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:17.147416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:17.148065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:17.313743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:17.322897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-69b39eba-f1b6-4149-82ee-120e0dfc0e61 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.189710 Aug 08 02:35:17.323831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 198/408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:17 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:18.082376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:18.083534 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:18.092817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:18.094201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:18.094945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:18.096036 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:18.096900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:18.097598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:18.353912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:18.353912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:18.367763 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:18.368268 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:18.368975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:18.369692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:18.370714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:18.371715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:18.378625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:18.389370 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ab958e72-2ee3-417d-8bb3-7c4db2a6f4b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.315573 Aug 08 02:35:18.389962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 211/409] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:18 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:18.640402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:18.648663 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ae1e9848-45b5-4102-8da3-9a577f420232 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.308603 Aug 08 02:35:18.649810 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 199/410] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:18 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:19.413080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:19.413863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:19.430109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:19.430109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:19.430109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:19.440323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:19.440869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:19.441310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:19.651168 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:19.676676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:19.678748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:19.698011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-25f4a118-cf83-4c1d-9445-4c1bcc5ead46 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.275648 Aug 08 02:35:19.698142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:19.698142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:19.698335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 212/411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:19 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:19.698453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:19.698453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:19.698453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:19.698453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:19.901861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:19.904541 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=4 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:19.921597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-59a1ccf1-aaff-4cc9-8a97-3c2d8c5d6479 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.249664 Aug 08 02:35:19.925065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 200/412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:19 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:20.719426 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:20.720190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:20.757371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:20.758011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:20.758616 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:20.759468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:20.761009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:20.763942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:20.958407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:20.959039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:20.978294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=8 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:20.998200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:20.998845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:20.999153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:21.000956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:21.003713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:21.005681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:21.119861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:21.133410 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f43fdd24-6ff0-41c9-895f-fa9c2808ce9d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.418728 Aug 08 02:35:21.137269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 213/413] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:20 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:21.232434 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:21.240301 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2cbc0279-a2a2-45ed-b4fb-658decc34914 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.292757 Aug 08 02:35:21.241194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 201/414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:20 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:21.352812 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0dfc983d-3a59-4b74-ae7a-2c4af37ce57f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: .version_select at 0x7fb2bab355e0>, body: {"keypair": {"name": "tempest-keypair-1669914246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBNZM6tyJV6LrSYviHw3sMEHAbKy+wacXFGF8sc23C/8E7QcIem5S1BqHyQDDPIl2pWRcY00d+xv4pxCS+t5knDBT0ZsggrwGyhWnm5HsP3/+V5uRZ1recls03KVZwoKQ=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:21.386288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-0dfc983d-3a59-4b74-ae7a-2c4af37ce57f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for project 897030a5075b4ca3ad29d73371306a66. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:35:21.395832 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-0dfc983d-3a59-4b74-ae7a-2c4af37ce57f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for user 55afeedd651248da8ac80c61fb0729cc and project 897030a5075b4ca3ad29d73371306a66. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:35:21.529682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0dfc983d-3a59-4b74-ae7a-2c4af37ce57f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.325716 Aug 08 02:35:21.531619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 214/415] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:35:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:22.159279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:22.159892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:22.172358 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:22.173035 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:22.173611 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:22.175181 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:22.175953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:22.176470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:22.264241 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:22.264980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:22.271785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:22.272386 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:22.272985 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:22.274145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:22.274819 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:22.275442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:22.353113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:22.362462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ff600d63-c700-428e-abdb-0100626887dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.207336 Aug 08 02:35:22.363515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 202/416] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:22 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:22.456360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:22.465544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-39659ceb-b454-4edb-a80e-c39e3e4618b6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.205522 Aug 08 02:35:22.466131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 215/417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:22 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:23.056196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-32f367f2-3738-4c1a-bb6d-00c1d20bd5de req-55ef1b82-381c-45a3-b53d-a0750b8d4abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998bc6f6-7f4e-4219-ba48-4d047531c55c", "name": "network-vif-plugged", "status": "completed", "tag": "06ece2e5-1c70-462c-91bf-e4c9507cc4d4"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:23.068013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-32f367f2-3738-4c1a-bb6d-00c1d20bd5de req-55ef1b82-381c-45a3-b53d-a0750b8d4abc service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:23.068911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-32f367f2-3738-4c1a-bb6d-00c1d20bd5de req-55ef1b82-381c-45a3-b53d-a0750b8d4abc service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:23.069565 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-32f367f2-3738-4c1a-bb6d-00c1d20bd5de req-55ef1b82-381c-45a3-b53d-a0750b8d4abc service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:23.087469 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-32f367f2-3738-4c1a-bb6d-00c1d20bd5de req-55ef1b82-381c-45a3-b53d-a0750b8d4abc service nova] Creating event network-vif-plugged:06ece2e5-1c70-462c-91bf-e4c9507cc4d4 for instance 998bc6f6-7f4e-4219-ba48-4d047531c55c on hv-cinder-85226 Aug 08 02:35:23.095411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-32f367f2-3738-4c1a-bb6d-00c1d20bd5de req-55ef1b82-381c-45a3-b53d-a0750b8d4abc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043582 Aug 08 02:35:23.096547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 203/418] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:23.383368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:23.384553 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:23.391648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:23.392423 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:23.393145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:23.394022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:23.394649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:23.395219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:23.487489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:23.488215 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:23.499802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:23.499802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:23.499802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:23.499802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:23.500164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:23.500164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:23.594046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:23.614011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d3f2b563-556d-4462-8c35-65d7cf06b32e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.225443 Aug 08 02:35:23.614011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 216/419] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:23 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:23.659489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:23.667602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3f2ce9ec-c3a1-432b-8fcc-b170ab5c23a9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.184773 Aug 08 02:35:23.681451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 204/420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:23 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:24.632569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:24.633386 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:24.655225 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:24.656132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:24.658629 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:24.659266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:24.659724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:24.660150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:24.689234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:24.689856 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:24.702927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:24.703422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:24.708123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:24.708123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:24.708123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:24.708123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:24.916950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:24.924907 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-91a223ab-f328-46ea-8963-3850b81d94c2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.296032 Aug 08 02:35:24.926047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 217/421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:24 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:24.932209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1502974883", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "682376b8-1891-42b8-8562-21125b626ab2"}], "security_groups": [{"name": "tempest-securitygroup--228479036"}], "key_name": "tempest-keypair-1669914246", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:24.970659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:24.982050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-76ca5747-8273-4c9e-b876-fb9d865fcb0f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.296625 Aug 08 02:35:24.995504 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 205/422] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:24 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:25.060485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] validate_networks() for [('682376b8-1891-42b8-8562-21125b626ab2', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:35:25.472388 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:25.475045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:25.478799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:25.479281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:25.479710 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:25.480423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:25.480882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:25.481295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:25.499920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:25.592904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:35:25.593322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:35:25.593794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:35:25.594270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:35:25.594613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:35:25.606758 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:25.607244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:25.607713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:25.608808 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:25.609429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:25.609856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:25.625710 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:25.627857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for project 897030a5075b4ca3ad29d73371306a66. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:35:25.632212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for user 55afeedd651248da8ac80c61fb0729cc and project 897030a5075b4ca3ad29d73371306a66. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:35:25.634047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7d8bdb05-5f8f-4e78-a48c-d256707d03a1 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1592 microversion: 2.1 time: 0.165442 Aug 08 02:35:25.634639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 206/423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:25 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1592 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:25.644490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:35:25.646952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:35:25.791625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aafcb977-be20-4886-915c-c2cb917b4824 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.864243 Aug 08 02:35:25.792552 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 218/424] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:35:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:35:25.803962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6c17a2d2-3d6f-4540-a62b-7c04e98fc1d4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:25.804815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6c17a2d2-3d6f-4540-a62b-7c04e98fc1d4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:25.872309 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6c17a2d2-3d6f-4540-a62b-7c04e98fc1d4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:25.880641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6c17a2d2-3d6f-4540-a62b-7c04e98fc1d4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1238 microversion: 2.1 time: 0.080414 Aug 08 02:35:25.881896 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 207/425] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:25 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:25.946017 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:25.946810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:25.964512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:25.967047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:25.968535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:25.970178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:25.971344 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:25.971880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:26.004217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:26.004874 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:26.016971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:26.017458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:26.018685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:26.020176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:26.022248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:26.024471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:26.196530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:26.199780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c3f926e7-8412-4b85-bc1b-b3e3216489ed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.257934 Aug 08 02:35:26.200357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 219/426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:25 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:26.342953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:26.368791 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2ed381ee-840e-4455-9785-3215e9f2c53b tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.367306 Aug 08 02:35:26.369589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 208/427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:25 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:26.903142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c7ddc3e6-bf8d-4071-a6c6-0355dd6b9bab tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:26.908428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c7ddc3e6-bf8d-4071-a6c6-0355dd6b9bab tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:27.015034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c7ddc3e6-bf8d-4071-a6c6-0355dd6b9bab tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:27.030993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c7ddc3e6-bf8d-4071-a6c6-0355dd6b9bab tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1238 microversion: 2.1 time: 0.132915 Aug 08 02:35:27.034574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 220/428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:26 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:27.222172 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:27.222863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:27.228966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.229448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.229877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.235209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.235209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.235209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.393681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:27.394434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:27.402116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.403406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.403851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.405173 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.405858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.406290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.646396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:27.654556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1a1e43f7-6fef-4474-89c6-b78713181bd3 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1318 microversion: 2.1 time: 0.265292 Aug 08 02:35:27.655213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 221/429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:27 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:27.749036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:27.757263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-16e1e11c-a69c-43a7-a9bb-371e4eb05fa4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1500 microversion: 2.1 time: 0.539089 Aug 08 02:35:27.757844 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 209/430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:27 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1500 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:27.783040 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a059ce5e-6f91-4454-be82-5f6d7409d889"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:27.785473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:27.787470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:27.800506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.800991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.801429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.802135 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.802613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.803038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.853390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] HTTP exception thrown: Cannot 'attach_volume' instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 while it is in vm_state rescued Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Request method failure captured: Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/os-volume_attachments HTTP/1.1 Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 74 Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW4UlCKJdsfVo1Yrub2DfbsQUnl56LGKCg8UwvCa3txiYym0JrUsoXuW_CnUiVUildOjZo9GLYB4DgWAajQ89ZQUG0v5MQhNaqRYSpF43ngQyWSiPwaFBAzHGoBC_pEJEFhiHmHNIVrkv2ZiwY_DJTB76YyD8PuhUJJDO4vqeoBlT8 Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:35:27.855122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f1f194384993444da5c7b7f30e42746d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f6fb96d9442147e0a2201fe890d6f955 Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {"volumeAttachment": {"volumeId": "a059ce5e-6f91-4454-be82-5f6d7409d889"}} Aug 08 02:35:27.857396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Cannot 'attach_volume' instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 while it is in vm_state rescued Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'server_id': '4449d47c-fbac-4e23-8017-0a283a5ba7d9', 'body': {'volumeAttachment': {'volumeId': 'a059ce5e-6f91-4454-be82-5f6d7409d889'}}} Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:35:27.860735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 while it is in vm_state rescued Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:27.862782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 while it is in vm_state rescued Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Returning 409 to user: Cannot 'attach_volume' instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 while it is in vm_state rescued {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e1c9d3c6-0744-4c26-a722-ef024f768814 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078224 Aug 08 02:35:27.864090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 222/431] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:35:27 2022] POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 02:35:27.866859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:27.867397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:27.875383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.876609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.877210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:27.878509 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:27.879116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:27.879953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.057366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:28.058136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:28.066204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:28.066666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:28.067405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.069367 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:28.070088 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:28.070783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.078103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-094d7651-bbdd-4024-88e4-28c814ed6397 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/action" status: 202 len: 0 microversion: 2.1 time: 0.215463 Aug 08 02:35:28.080494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 210/432] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:35:27 2022] POST /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:35:28.098649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:28.100215 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:28.137180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:28.141524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:28.142019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.145288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:28.145827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:28.148355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.149061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:28.160677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6c13e5ed-2ff4-41f5-becd-23541b887874 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1234 microversion: 2.1 time: 0.107319 Aug 08 02:35:28.161581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 223/433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:28 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1234 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:28.466619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:28.474142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-345c00e5-4910-4ea1-9eba-d27604b4b171 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1508 microversion: 2.1 time: 0.387084 Aug 08 02:35:28.474750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 211/434] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:28 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1508 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:28.686233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:28.686883 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:28.693605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:28.694109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:28.694671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.695376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:28.695823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:28.699693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:28.909080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:28.926189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1f649b6b-a60a-4216-9fa4-00a0ab31f1fb tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1507 microversion: 2.1 time: 0.247946 Aug 08 02:35:28.929850 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 224/435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:28 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:29.187353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:29.187887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:29.201479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.201975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.202445 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:29.203152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.210646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.210646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:29.329479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:29.331118 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-59b1c2a4-d9d7-497d-978c-f1bf76b2f855 req-125430fc-9deb-4445-abc7-3c975f8a937f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:29.336704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1fe60ea6-22d7-4428-884d-5a31b42f4482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1290 microversion: 2.1 time: 0.153340 Aug 08 02:35:29.337804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 212/436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:29 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1290 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:29.343303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-59b1c2a4-d9d7-497d-978c-f1bf76b2f855 req-125430fc-9deb-4445-abc7-3c975f8a937f service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.343815 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-59b1c2a4-d9d7-497d-978c-f1bf76b2f855 req-125430fc-9deb-4445-abc7-3c975f8a937f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.344242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-59b1c2a4-d9d7-497d-978c-f1bf76b2f855 req-125430fc-9deb-4445-abc7-3c975f8a937f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:29.359749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-59b1c2a4-d9d7-497d-978c-f1bf76b2f855 req-125430fc-9deb-4445-abc7-3c975f8a937f service nova] Creating event network-changed:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:35:29.365571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-59b1c2a4-d9d7-497d-978c-f1bf76b2f855 req-125430fc-9deb-4445-abc7-3c975f8a937f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039442 Aug 08 02:35:29.366187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 225/437] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:35:29.497700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:29.499086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:29.520280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.520774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.524959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:29.526287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.526789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.527262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:30.196250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:30.207851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e290afb1-a376-44ed-b53d-160830fe33eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1508 microversion: 2.1 time: 0.712708 Aug 08 02:35:30.216591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 213/438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:29 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1508 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:30.361565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:30.362388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:30.373924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:30.378417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:30.379169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:30.380319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:30.382150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:30.382820 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:30.415978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:30.494847 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:30.508674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c0823bba-009b-41fe-a81b-30d0602de24a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1308 microversion: 2.1 time: 0.154308 Aug 08 02:35:30.509490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 226/439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:30 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:31.227578 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:31.228193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:31.255706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:31.257343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:31.257848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:31.258284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:31.259030 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:31.259486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:31.259912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:31.531643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:31.532246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:31.555173 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:31.558025 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:31.560046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:31.561718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:31.565331 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:31.574842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:31.682603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:31.691387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8b11c9e4-ae14-4943-88e1-61d90b3ae895 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1508 microversion: 2.1 time: 0.467615 Aug 08 02:35:31.705697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 214/440] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:31 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:31.714246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:31.728280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-84954bec-827d-4581-8320-cceacb61d6f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1296 microversion: 2.1 time: 0.200802 Aug 08 02:35:31.741756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 227/441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:31 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1296 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:32.713200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:32.713807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:32.721058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:32.721553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:32.721993 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:32.722720 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:32.723174 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:32.724592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:32.749452 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:32.755878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:32.769161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:32.769655 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:32.770091 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:32.770821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:32.771277 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:32.771704 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:32.907849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:32.924958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-237f1351-8dd4-446c-a1e9-44f82ff232f7 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1508 microversion: 2.1 time: 0.215840 Aug 08 02:35:32.926086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 215/442] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:32 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:33.014888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:33.024234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e29e02ca-696b-4645-a90d-c9cbca51aa34 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.278983 Aug 08 02:35:33.025606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 228/443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:32 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:33.439131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1370271872"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:33.439675 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:33.449334 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:33.449829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:33.450264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:33.451055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:33.451503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:33.459125 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:33.632851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.network.security_group_api [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Adding security group 7f7711eb-fcaa-4daa-a144-201e3b1c9867 to port b1663d83-3f81-40a7-968b-47e96bdf8eb3 Aug 08 02:35:33.952450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:33.953068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:33.962155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:33.963028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:33.964267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:33.966163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:33.966971 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:33.967651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:34.149463 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:34.157626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-af07a923-7140-488d-972c-489fdf8b0082 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1508 microversion: 2.1 time: 0.209887 Aug 08 02:35:34.158270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 229/444] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:33 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:34.163171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:34.163933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:34.171830 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:34.172535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:34.173146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:34.174114 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:34.174601 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:34.175032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:34.209428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-367511f8-c1a3-4ab4-9a79-09f54aaf7548 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/action" status: 202 len: 0 microversion: 2.1 time: 0.774076 Aug 08 02:35:34.214441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 216/445] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:35:33 2022] POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:35:34.218012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:34.218707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:34.225037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:34.225764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:34.226332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:34.227533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:34.228176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:34.228843 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:34.333574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:34.342751 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9aa7ac2c-4ac2-4649-8742-d5c56bae1554 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.183186 Aug 08 02:35:34.356167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 230/446] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:34 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:34.361242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b61f4334-3d45-44db-8de8-85c34e387b00 req-28bd21ba-35e4-46bf-86b7-142c9d8919d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:34.371139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b61f4334-3d45-44db-8de8-85c34e387b00 req-28bd21ba-35e4-46bf-86b7-142c9d8919d7 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:34.371821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b61f4334-3d45-44db-8de8-85c34e387b00 req-28bd21ba-35e4-46bf-86b7-142c9d8919d7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:34.372430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b61f4334-3d45-44db-8de8-85c34e387b00 req-28bd21ba-35e4-46bf-86b7-142c9d8919d7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:34.385780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-b61f4334-3d45-44db-8de8-85c34e387b00 req-28bd21ba-35e4-46bf-86b7-142c9d8919d7 service nova] Creating event network-changed:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:35:34.392891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b61f4334-3d45-44db-8de8-85c34e387b00 req-28bd21ba-35e4-46bf-86b7-142c9d8919d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034652 Aug 08 02:35:34.394155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 231/447] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:34.720746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:34.738200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a5254a09-56bf-4596-92bc-8c7cd4919949 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1639 microversion: 2.1 time: 0.523886 Aug 08 02:35:34.739021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 217/448] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:34 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1639 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:35.181092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:35.182337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:35.189797 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:35.190873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:35.191507 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:35.192372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:35.192976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:35.193566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:35.363267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:35.364025 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:35.370401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:35.371231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:35.371909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:35.372969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:35.373632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:35.374247 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:35.392945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:35.413144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d888715f-4a39-475d-94d6-cb15fce77708 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1514 microversion: 2.1 time: 0.237664 Aug 08 02:35:35.414467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 232/449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:35 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:35.879882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:36.205457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:36.213088 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a05ec527-7bb1-4c68-a4ab-23456cbb1675 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.853602 Aug 08 02:35:36.213697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 218/450] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:35 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:36.536633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-dc0fd711-611f-4284-ae0d-9790b7e3368c req-a000dbd7-4065-4ea9-a3e4-f20cfcdad4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ed21ea-bc5e-4251-bcc7-fbfe640ab747", "tag": "fdd841cc-5aaf-433c-8961-a1c99eafc2ff"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:36.546286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:36.549186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dc0fd711-611f-4284-ae0d-9790b7e3368c req-a000dbd7-4065-4ea9-a3e4-f20cfcdad4ca service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:36.549670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dc0fd711-611f-4284-ae0d-9790b7e3368c req-a000dbd7-4065-4ea9-a3e4-f20cfcdad4ca service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:36.550107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dc0fd711-611f-4284-ae0d-9790b7e3368c req-a000dbd7-4065-4ea9-a3e4-f20cfcdad4ca service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:36.562082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-dc0fd711-611f-4284-ae0d-9790b7e3368c req-a000dbd7-4065-4ea9-a3e4-f20cfcdad4ca service nova] Creating event network-changed:fdd841cc-5aaf-433c-8961-a1c99eafc2ff for instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 on hv-cinder-85226 Aug 08 02:35:36.571944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-dc0fd711-611f-4284-ae0d-9790b7e3368c req-a000dbd7-4065-4ea9-a3e4-f20cfcdad4ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034551 Aug 08 02:35:36.571944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 233/451] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:37.235995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:37.236620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:37.243151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:37.244209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:37.244831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:37.245783 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:37.246733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:37.247168 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:37.580580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:37.588120 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d6b4b403-5b1d-4758-a9fb-348983a2435f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.357613 Aug 08 02:35:37.601505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 219/452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:37 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:38.242551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=12 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:38.248577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5ab49405-1062-475b-a9c7-39d6c25899bf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'create', calling method: .version_select at 0x7fb2bab4b8b0>, body: {"keypair": {"name": "tempest-keypair-1219070230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuMYqZjy7+PKyZ0bU8lrfzu4bnhqwZdfy9jTyiXE3iB4Mouaw2GFeRaJbnqPMLG7/kHQNzrnxDYIXulEafjEOaMAdzHm9SOYfjppW8+uEQBaUWEBnET3mDAZfwwCOhaNQ=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:38.265909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-5ab49405-1062-475b-a9c7-39d6c25899bf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for project f1f194384993444da5c7b7f30e42746d. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:35:38.269989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-5ab49405-1062-475b-a9c7-39d6c25899bf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for user f6fb96d9442147e0a2201fe890d6f955 and project f1f194384993444da5c7b7f30e42746d. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:35:38.372152 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5ab49405-1062-475b-a9c7-39d6c25899bf tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130308 Aug 08 02:35:38.373755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 234/453] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:35:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:38.611066 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:38.611687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:38.618591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:38.619146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:38.619592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:38.620342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:38.621008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:38.621591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:38.789704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:38.798968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3e898e15-547f-473f-9349-69f2d94ce728 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.193481 Aug 08 02:35:38.804296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 220/454] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:38 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:39.823417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:39.825422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:39.832635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:39.833447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:39.834103 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:39.834924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:39.835446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:39.835938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:40.068654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:40.076937 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7c9378e2-180a-4d37-9b6a-e90c3817bd97 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.258848 Aug 08 02:35:40.090666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 235/455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:39 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:41.097961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:41.099240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:41.106556 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:41.107524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:41.107967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:41.109017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:41.109615 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:41.110051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:41.295785 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:41.304936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8b759f6a-d81d-4321-a946-482759ed4608 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.211336 Aug 08 02:35:41.305661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 221/456] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:41 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:41.738728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-199199780", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a983a294-01dc-46eb-aef5-c79712b4e933"}], "security_groups": [{"name": "tempest-securitygroup--921261653"}], "key_name": "tempest-keypair-1219070230", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:41.892943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] validate_networks() for [('a983a294-01dc-46eb-aef5-c79712b4e933', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:35:42.327836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:42.328465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:42.338614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:42.338958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:42.339404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:42.348197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:42.349917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:42.350389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:42.509190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:35:42.509644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:35:42.510132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:35:42.511691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:35:42.512147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:35:42.524886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:42.524886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:42.529426 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:42.530331 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:42.530852 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:42.531312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:42.556130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for project f1f194384993444da5c7b7f30e42746d. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:35:42.561197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Getting quotas for user f6fb96d9442147e0a2201fe890d6f955 and project f1f194384993444da5c7b7f30e42746d. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:35:42.576575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:35:42.582225 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:35:42.604184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:42.614753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-509ac50a-a055-4ae2-9969-196d0933771b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.293086 Aug 08 02:35:42.615343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 222/457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:42 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:42.745495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bb2e3fe7-4e33-417a-b96d-9ae47817c7ac tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.011261 Aug 08 02:35:42.747542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 236/458] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:35:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:35:42.758300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-abb3ab5f-9cd4-4963-8eb2-cdb05dfcb68f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:42.758944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-abb3ab5f-9cd4-4963-8eb2-cdb05dfcb68f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:42.821985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-abb3ab5f-9cd4-4963-8eb2-cdb05dfcb68f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:42.830743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-abb3ab5f-9cd4-4963-8eb2-cdb05dfcb68f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1245 microversion: 2.1 time: 0.076194 Aug 08 02:35:42.854172 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 223/459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:42 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:43.639324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:43.639938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:43.647534 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:43.648022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:43.648456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:43.649152 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:43.649603 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:43.650026 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:43.822323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:43.831635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e94cdbad-61dd-4214-bafa-2b22a6f8404d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.198943 Aug 08 02:35:43.832861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 237/460] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:43 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:43.857937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-da1b97f3-a12f-49c3-bfcc-e5145da08790 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:43.857937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-da1b97f3-a12f-49c3-bfcc-e5145da08790 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:43.982213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-da1b97f3-a12f-49c3-bfcc-e5145da08790 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:43.999926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-da1b97f3-a12f-49c3-bfcc-e5145da08790 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1245 microversion: 2.1 time: 0.149397 Aug 08 02:35:44.000974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 224/461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:43 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1245 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:44.858288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:44.860355 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:44.880265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:44.880752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:44.888502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:44.890705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:44.891729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:44.892172 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:45.022959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:45.024328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:45.045628 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:45.046444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:45.047101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:45.047977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:45.048781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:45.049412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:45.077872 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:45.108122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:45.118003 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1308a9ea-28b5-46b6-acd9-30c956539ad8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.267885 Aug 08 02:35:45.118743 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 238/462] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:44 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:45.155152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:45.170615 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-28fb23cf-4460-46bc-9fef-8d0220c35a7d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1241 microversion: 2.1 time: 0.151900 Aug 08 02:35:45.194752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 225/463] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:45 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1241 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:45.850436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-03029416-c890-406e-ae2c-039f0b28d5ef req-cbf42e60-50c4-4f6d-8622-ec31269bc0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ed21ea-bc5e-4251-bcc7-fbfe640ab747", "name": "network-vif-plugged", "status": "completed", "tag": "fdd841cc-5aaf-433c-8961-a1c99eafc2ff"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:45.859693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-03029416-c890-406e-ae2c-039f0b28d5ef req-cbf42e60-50c4-4f6d-8622-ec31269bc0c5 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:45.860293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-03029416-c890-406e-ae2c-039f0b28d5ef req-cbf42e60-50c4-4f6d-8622-ec31269bc0c5 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:45.860522 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-03029416-c890-406e-ae2c-039f0b28d5ef req-cbf42e60-50c4-4f6d-8622-ec31269bc0c5 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:45.872007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-03029416-c890-406e-ae2c-039f0b28d5ef req-cbf42e60-50c4-4f6d-8622-ec31269bc0c5 service nova] Creating event network-vif-plugged:fdd841cc-5aaf-433c-8961-a1c99eafc2ff for instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 on hv-cinder-85226 Aug 08 02:35:45.878874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-03029416-c890-406e-ae2c-039f0b28d5ef req-cbf42e60-50c4-4f6d-8622-ec31269bc0c5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032704 Aug 08 02:35:45.880088 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 239/464] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:46.140708 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:46.142002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:46.150603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:46.151343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:46.151771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:46.153167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:46.153800 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:46.154219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:46.194745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:46.195817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:46.214233 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:46.218199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:46.221035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:46.222004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:46.222934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:46.224543 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:46.335429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:46.354079 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3831ef1a-bcf3-420e-95f0-e3c13880e2e8 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1315 microversion: 2.1 time: 0.164648 Aug 08 02:35:46.354949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 240/465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:46 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:46.501668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:46.510048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f1be8ccb-eaac-4f78-a6bf-211399306d2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.374693 Aug 08 02:35:46.528562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 226/466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:46 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:47.376248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:47.376871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:47.383218 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:47.383928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:47.384364 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:47.385064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:47.385521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:47.386135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:47.445902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec701bcc-3255-4e31-a910-899a26adaee9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Action: 'create', calling method: .version_select at 0x7fb2bab358b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-459619722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRx+CvTgk61vd0TwHGSXJ/PIs52s/hZKACmONNVpiIL/MPE5Z2FtVlp39sqvK3zWApWGo7Rozzl/7uYH5PjEm7qahHRrJrI1DaK+6+sJoR9swfCIFmVlBvhuVstnke2Sw=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:47.462596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-ec701bcc-3255-4e31-a910-899a26adaee9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Getting quotas for project e069855c07d94296a331d49a7a2a7ce4. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:35:47.466637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-ec701bcc-3255-4e31-a910-899a26adaee9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Getting quotas for user 0fe07f55f4d54059a193d4611e0a4f92 and project e069855c07d94296a331d49a7a2a7ce4. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:35:47.471539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:47.479798 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c6754c81-caa1-4d68-9f81-df6b79e5ec9b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1303 microversion: 2.1 time: 0.108128 Aug 08 02:35:47.480729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 227/467] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:47 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:47.530723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:47.531368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:47.537324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:47.537808 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:47.538304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:47.539303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:47.539766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:47.540200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:47.570791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec701bcc-3255-4e31-a910-899a26adaee9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.316409 Aug 08 02:35:47.590846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 241/468] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:35:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:47.704248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:47.715004 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94e3221d-92b8-4e1b-bc33-3594ad1f1e7e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.188244 Aug 08 02:35:47.716625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 228/469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:47 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:35:48.504849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:48.505468 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:48.514899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:48.515388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:48.515828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:48.516855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:48.517505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:48.517942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:48.584069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:48.595099 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d7b70d94-cf28-4650-aa17-ec17725f307b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1303 microversion: 2.1 time: 0.091754 Aug 08 02:35:48.595099 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 242/470] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:48 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:48.737418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:48.738196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:48.745190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:48.746631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:48.747138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:48.748073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:48.748633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:48.749161 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:48.917363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:48.935392 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d480d15d-ef15-410a-919f-6a6d12dad625 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.201972 Aug 08 02:35:48.936529 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 229/471] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:48 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:49.613347 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:49.614039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:49.622040 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.622887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.623437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.624374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.625065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.625548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.698490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:49.706598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a1fd76e3-63cd-45e0-bb48-fbe390461540 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1303 microversion: 2.1 time: 0.096913 Aug 08 02:35:49.707572 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 243/472] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:49 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:49.957551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:49.958171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:49.973064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.973559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.974191 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.975729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.976549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.977128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:50.188160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:50.196303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d34ce5b9-408c-4738-a457-12a5c9203e96 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.243069 Aug 08 02:35:50.203917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 230/473] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:49 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:50.728323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:50.729065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:50.735391 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:50.735873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:50.736307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:50.737004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:50.737504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:50.738008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:50.881396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:50.889737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cf1eb8e1-20e0-4b20-bdb4-f8d2a6ce6d4e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.165304 Aug 08 02:35:50.890321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 244/474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:50 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:51.218875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:51.223954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:51.225520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.225999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.226455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:51.227190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.227640 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.228058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:51.361518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:51.369021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7310c768-97ec-4ffc-bb59-aff25b396e2e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.154710 Aug 08 02:35:51.369583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 231/475] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:51 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:51.909897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:51.910485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:51.916978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.923134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.923134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:51.923134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.923134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.923529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:52.051302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:52.058691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-93f503f1-b2d6-46e8-b4a9-aac0849015cd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.152725 Aug 08 02:35:52.059289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 245/476] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:51 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:52.390397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:52.391607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:52.398112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:52.398781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:52.399219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:52.399920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:52.400375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:52.400799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:52.642840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:52.650207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6171f064-c756-40ba-a213-9457688855d2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.265073 Aug 08 02:35:52.653049 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 232/477] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:52 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:53.080067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:53.080677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:53.082792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:53.088480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.088480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.088798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.089554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.090012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.090459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.189521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-4610fe6f-a66d-47a7-a0b0-aea82229b8b9 req-2d6181ce-4df6-4d90-8acf-40b0eb9bc158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b62cb1-88d8-45e9-b506-339fedab711a", "tag": "02e01264-c556-4152-ab45-aa8f19b46808"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:53.209106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4610fe6f-a66d-47a7-a0b0-aea82229b8b9 req-2d6181ce-4df6-4d90-8acf-40b0eb9bc158 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.209737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4610fe6f-a66d-47a7-a0b0-aea82229b8b9 req-2d6181ce-4df6-4d90-8acf-40b0eb9bc158 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.210268 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4610fe6f-a66d-47a7-a0b0-aea82229b8b9 req-2d6181ce-4df6-4d90-8acf-40b0eb9bc158 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.223866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-4610fe6f-a66d-47a7-a0b0-aea82229b8b9 req-2d6181ce-4df6-4d90-8acf-40b0eb9bc158 service nova] Creating event network-changed:02e01264-c556-4152-ab45-aa8f19b46808 for instance 08b62cb1-88d8-45e9-b506-339fedab711a on hv-cinder-85226 Aug 08 02:35:53.229415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-4610fe6f-a66d-47a7-a0b0-aea82229b8b9 req-2d6181ce-4df6-4d90-8acf-40b0eb9bc158 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044803 Aug 08 02:35:53.230283 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 233/478] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:35:53.261810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:53.270474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-042cfe90-f8fc-48ce-9cf8-6802c2f85f70 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.195202 Aug 08 02:35:53.271045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 246/479] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:53 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:53.672646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:53.673326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:53.679624 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.680132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.680557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.681241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.681688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.682105 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.830260 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:53.838122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5a8618f8-ce81-4509-bebd-f972851ec411 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1363 microversion: 2.1 time: 0.170203 Aug 08 02:35:53.838751 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 234/480] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:53 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:54.292773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:54.293612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:54.300943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:54.301444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:54.302392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:54.302663 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:54.303121 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:54.303553 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:54.434736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:54.438193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:54.442637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-66bccde9-8de7-41b7-9214-eabfcdbaba8b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.154077 Aug 08 02:35:54.443368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 247/481] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:54 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:54.859563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:54.862564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:54.862564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=4 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:54.867338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:54.867813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:54.868240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:54.868921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:54.869417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:54.869780 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:55.083816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:55.091429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e9133f8f-89e0-454b-a76c-2cc976d7ae21 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1549 microversion: 2.1 time: 0.235682 Aug 08 02:35:55.092195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 235/482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:54 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1549 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:55.111795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:55.112403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:55.119035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:55.119574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:55.119959 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:55.120684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:55.121223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:55.121656 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:55.209882 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d478ae09-f6bd-4dbd-b120-d213f88819a7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101997 Aug 08 02:35:55.210497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 248/483] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:35:55 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:55.463687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:55.464310 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:55.474190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:55.474703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:55.475322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:55.476016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:55.476463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:55.476882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:55.619231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:55.627720 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c1352ead-a63e-4224-be9a-979ea95a06ca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.168156 Aug 08 02:35:55.628296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 236/484] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:55 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:56.653421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:56.654104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:56.660810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:56.661296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:56.661742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:56.662447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:56.662903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:56.663329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:56.705648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-d6f46bad-b13a-44d1-bf3a-5907b4d3d5f8 req-6b87e8fd-c3c8-419d-858e-5985e65db9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ed21ea-bc5e-4251-bcc7-fbfe640ab747", "tag": "fdd841cc-5aaf-433c-8961-a1c99eafc2ff"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:56.732007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d6f46bad-b13a-44d1-bf3a-5907b4d3d5f8 req-6b87e8fd-c3c8-419d-858e-5985e65db9f4 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:56.732333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d6f46bad-b13a-44d1-bf3a-5907b4d3d5f8 req-6b87e8fd-c3c8-419d-858e-5985e65db9f4 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:56.732738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d6f46bad-b13a-44d1-bf3a-5907b4d3d5f8 req-6b87e8fd-c3c8-419d-858e-5985e65db9f4 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:56.756946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-d6f46bad-b13a-44d1-bf3a-5907b4d3d5f8 req-6b87e8fd-c3c8-419d-858e-5985e65db9f4 service nova] Creating event network-changed:fdd841cc-5aaf-433c-8961-a1c99eafc2ff for instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 on hv-cinder-85226 Aug 08 02:35:56.766758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-d6f46bad-b13a-44d1-bf3a-5907b4d3d5f8 req-6b87e8fd-c3c8-419d-858e-5985e65db9f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065223 Aug 08 02:35:56.768146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 237/485] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:35:56.834433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:56.842252 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-43418007-6f14-4288-a0c9-00d4a24ec37d tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.197144 Aug 08 02:35:56.842854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 249/486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:56 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:57.863510 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:57.864194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:57.870304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:57.870812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:57.871240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:57.871947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:57.872488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:57.872950 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:58.015087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:58.022760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-09363111-8637-41e2-9ee6-08d96c442778 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.163507 Aug 08 02:35:58.023329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 238/487] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:57 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:59.043088 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:59.043756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:59.046078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=14 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:59.047258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:59.051940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:59.053488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:59.053488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:59.053698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:59.054006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:59.054473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:59.200827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:59.209110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5504d641-b3c4-4452-959e-08d9ecb35fed tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.169743 Aug 08 02:35:59.209709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 250/488] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:59 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:00.229086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:00.229729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:00.236544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:00.237050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:00.237481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:00.238171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:00.238657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:00.239074 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:00.369200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:00.377487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cd19bce4-eb4a-4cf4-abe0-bb8fa71cb38a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.152228 Aug 08 02:36:00.378053 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 239/489] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:00 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:01.404098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:01.404716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:01.411900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:01.412385 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:01.412828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:01.413535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:01.414122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:01.414589 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:01.547594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:01.555277 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f28cb669-488c-4806-a6c9-cf79a419062b tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.154990 Aug 08 02:36:01.555862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 251/490] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:01 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:02.575913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:02.576528 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:02.584685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.585189 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.585628 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.586408 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.587095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.587527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.722321 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:02.729666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1115d232-9e25-4825-a58d-648d7f6885e2 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.157767 Aug 08 02:36:02.730242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 240/491] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:02 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:03.750481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:03.751099 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:03.757459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:03.757935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:03.758389 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.759079 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:03.759533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:03.759955 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.893737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:03.901721 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9c135e4f-7017-4b42-b4a5-4c0ce69afa91 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.155139 Aug 08 02:36:03.902307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 252/492] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:03 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:04.506220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-169ac800-e20b-41f3-8288-f05c45c148b4 req-8958f1f9-92ab-470c-9616-c5335454f957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b62cb1-88d8-45e9-b506-339fedab711a", "name": "network-vif-plugged", "status": "completed", "tag": "02e01264-c556-4152-ab45-aa8f19b46808"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:04.511137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=58 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:04.516818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-169ac800-e20b-41f3-8288-f05c45c148b4 req-8958f1f9-92ab-470c-9616-c5335454f957 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:04.517309 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-169ac800-e20b-41f3-8288-f05c45c148b4 req-8958f1f9-92ab-470c-9616-c5335454f957 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:04.517721 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-169ac800-e20b-41f3-8288-f05c45c148b4 req-8958f1f9-92ab-470c-9616-c5335454f957 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:04.529349 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-169ac800-e20b-41f3-8288-f05c45c148b4 req-8958f1f9-92ab-470c-9616-c5335454f957 service nova] Creating event network-vif-plugged:02e01264-c556-4152-ab45-aa8f19b46808 for instance 08b62cb1-88d8-45e9-b506-339fedab711a on hv-cinder-85226 Aug 08 02:36:04.535199 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-169ac800-e20b-41f3-8288-f05c45c148b4 req-8958f1f9-92ab-470c-9616-c5335454f957 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 Aug 08 02:36:04.535838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 241/493] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:04.922235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:04.922948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:04.929788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:04.930754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:04.931270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:04.932029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:04.932581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:04.933087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:05.063914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:05.071195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-533d96fc-7343-4f80-9fb2-78a52be88396 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.153328 Aug 08 02:36:05.071748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 253/494] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:04 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:06.092224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:06.093059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:06.099515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:06.099997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:06.100494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:06.101189 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:06.101644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:06.102093 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:06.233705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:06.241917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-147f7486-9c73-4c38-9740-34c59106aefd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1370 microversion: 2.1 time: 0.154007 Aug 08 02:36:06.242523 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 242/495] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:06 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:07.262525 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:07.263124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:07.270180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.270767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.271205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.271891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.272340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.272905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.407327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:07.414684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e4e3e8d9-1f8d-417d-a76d-eed2b899d76a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1562 microversion: 2.1 time: 0.155976 Aug 08 02:36:07.415239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 254/496] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:07 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:07.435386 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:07.437132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:07.443346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.443832 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.444629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.445154 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.445614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.446055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.525855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-311541ca-a20f-4775-bc6e-a073b9e8dc1f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094344 Aug 08 02:36:07.526481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 243/497] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:36:07 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:07.950535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426dc259-3c9c-48c6-a638-f591b578599f", "device": "/dev/sdb"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:07.953427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:07.959635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.960102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.960536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.961230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.961680 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.962106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:08.550198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-3a2c9636-4048-40a2-a5e0-44fffe17715a req-91d35958-5626-4f3f-acfc-7f7bcd0877ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b62cb1-88d8-45e9-b506-339fedab711a", "tag": "02e01264-c556-4152-ab45-aa8f19b46808"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:08.559662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3a2c9636-4048-40a2-a5e0-44fffe17715a req-91d35958-5626-4f3f-acfc-7f7bcd0877ab service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:08.560226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3a2c9636-4048-40a2-a5e0-44fffe17715a req-91d35958-5626-4f3f-acfc-7f7bcd0877ab service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:08.560675 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3a2c9636-4048-40a2-a5e0-44fffe17715a req-91d35958-5626-4f3f-acfc-7f7bcd0877ab service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:08.572149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-3a2c9636-4048-40a2-a5e0-44fffe17715a req-91d35958-5626-4f3f-acfc-7f7bcd0877ab service nova] Creating event network-changed:02e01264-c556-4152-ab45-aa8f19b46808 for instance 08b62cb1-88d8-45e9-b506-339fedab711a on hv-cinder-85226 Aug 08 02:36:08.577632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-3a2c9636-4048-40a2-a5e0-44fffe17715a req-91d35958-5626-4f3f-acfc-7f7bcd0877ab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030890 Aug 08 02:36:08.583014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 244/498] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:36:08.730868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-37830f9a-7b3f-4813-bf8b-ba42b850e3e5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "POST /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783710 Aug 08 02:36:08.731824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 255/499] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:36:07 2022] POST /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:32.585107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=7 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:32.585932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=98 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:32.590050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-908638016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-459619722", "security_groups": [{"name": "tempest-secgroup-smoke-560853521"}], "networks": [{"uuid": "72633b9c-b237-4ab8-8fff-e57a0fd5947a"}], "block_device_mapping_v2": [{"uuid": "bc6f0fc0-d06e-4009-9495-b03ba20c1b80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:32.703659 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] validate_networks() for [('72633b9c-b237-4ab8-8fff-e57a0fd5947a', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:36:33.070137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:36:33.070918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:36:33.071616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:36:33.072254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:36:33.072899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:36:33.082563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:33.083184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:33.083624 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:33.084389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:33.084848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:33.085275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:33.102587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Getting quotas for project e069855c07d94296a331d49a7a2a7ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:36:33.106510 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Getting quotas for user 0fe07f55f4d54059a193d4611e0a4f92 and project e069855c07d94296a331d49a7a2a7ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:36:33.162794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:36:33.164942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc6f0fc0-d06e-4009-9495-b03ba20c1b80',volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:36:33.551195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-efda01cd-9b1e-4b3f-9a12-626ed149fab2 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.967082 Aug 08 02:36:33.551839 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 245/500] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:36:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:36:33.563108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-efc3c1e1-d0d8-45fe-8411-6576bf964e0c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:33.564401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-efc3c1e1-d0d8-45fe-8411-6576bf964e0c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:33.568801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=11 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:33.569625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:33.621261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-efc3c1e1-d0d8-45fe-8411-6576bf964e0c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:33.629999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-efc3c1e1-d0d8-45fe-8411-6576bf964e0c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1087 microversion: 2.1 time: 0.070292 Aug 08 02:36:33.629999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 256/501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:33 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:34.648984 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:34.649633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:34.656418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:34.656893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:34.658306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:34.659018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:34.659469 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:34.659888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:34.721227 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:34.728614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-08feab5e-a3ae-4ac0-8688-e71f579c5029 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1137 microversion: 2.1 time: 0.083529 Aug 08 02:36:34.729167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 246/502] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:34 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:35.750380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:35.751056 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:35.757944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:35.758456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:35.758897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:35.759583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:35.760035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:35.760461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:35.821589 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:35.829636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-75a82f14-75d4-4c72-8bcb-4673b5810baf tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1137 microversion: 2.1 time: 0.083368 Aug 08 02:36:35.830652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 257/503] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:35 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:36.851189 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:36.851793 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:36.857652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:36.858128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:36.858588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:36.859270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:36.859713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:36.860153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:36.922223 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:36.930535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94f29753-fe1c-4650-9ac3-b43d2cba32cc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1129 microversion: 2.1 time: 0.083108 Aug 08 02:36:36.931099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 247/504] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:36 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1129 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:37.952116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:37.952722 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:37.960058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:37.960536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:37.961247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:37.961937 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:37.962404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:37.962834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:38.025350 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:38.035411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-40bd4f16-1da3-4276-8b5f-cceb7f2073d0 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1203 microversion: 2.1 time: 0.086893 Aug 08 02:36:38.036201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 258/505] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:37 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:39.057082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:39.057864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:39.064571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.065052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.065481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.066172 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.066656 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.067075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.267892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.275782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1987936d-7b21-463e-b4bd-b3c17e5c4c6a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1270 microversion: 2.1 time: 0.222524 Aug 08 02:36:39.276365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 248/506] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:39 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:39.634902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-f5bf9362-361e-4652-8bf6-935caea9149c req-de5dc3f2-7d5b-49de-8a03-f17ea9d6bb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:39.646182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f5bf9362-361e-4652-8bf6-935caea9149c req-de5dc3f2-7d5b-49de-8a03-f17ea9d6bb32 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.646708 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f5bf9362-361e-4652-8bf6-935caea9149c req-de5dc3f2-7d5b-49de-8a03-f17ea9d6bb32 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.647137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f5bf9362-361e-4652-8bf6-935caea9149c req-de5dc3f2-7d5b-49de-8a03-f17ea9d6bb32 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.658648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-f5bf9362-361e-4652-8bf6-935caea9149c req-de5dc3f2-7d5b-49de-8a03-f17ea9d6bb32 service nova] Creating event network-changed:2673af77-3e95-439c-83d1-409d6e88dcb5 for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 on hv-cinder-85226 Aug 08 02:36:39.663630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-f5bf9362-361e-4652-8bf6-935caea9149c req-de5dc3f2-7d5b-49de-8a03-f17ea9d6bb32 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032840 Aug 08 02:36:39.664189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 259/507] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:40.296387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:40.296992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:40.303392 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:40.303863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:40.304314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:40.304995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:40.305440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:40.305859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:40.469289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:40.477679 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-27030a2b-6c50-4d82-9fe9-043da935b586 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.185147 Aug 08 02:36:40.478297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 249/508] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:40 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:41.502406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:41.503099 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:41.509163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:41.509634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:41.510068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:41.510781 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:41.511232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:41.511656 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:41.645056 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:41.652469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-52ea6668-9962-4042-a8f7-bec3be5e34a9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.154820 Aug 08 02:36:41.653034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 260/509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:41 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:41.675079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:41.675573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:41.681293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:41.681766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:41.682193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:41.682896 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:41.683341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:41.683755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:41.804944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lazy-loading 'services' on Instance uuid 998bc6f6-7f4e-4219-ba48-4d047531c55c {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:36:42.045320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fd6df25d-676b-4500-85dc-3cbae9a07656 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "DELETE /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c/os-volume_attachments/426dc259-3c9c-48c6-a638-f591b578599f" status: 202 len: 0 microversion: 2.1 time: 0.374786 Aug 08 02:36:42.045912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 250/510] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:36:41 2022] DELETE /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c/os-volume_attachments/426dc259-3c9c-48c6-a638-f591b578599f => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:36:42.672959 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:42.673618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:42.680045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:42.680521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:42.680951 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:42.681630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:42.682076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:42.682529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:42.812761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:42.821784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ac289629-a373-4cd4-8026-dec240b6dcf4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.152675 Aug 08 02:36:42.822368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 261/511] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:42 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:43.168385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:43.169271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:43.174219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:43.177834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:43.181042 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.181519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.181947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.182649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.183100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.183517 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.212131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:36:43.520580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e7a888ab-af9e-4fd9-84c2-2d4f56cef90d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "DELETE /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 204 len: 0 microversion: 2.1 time: 0.352796 Aug 08 02:36:43.521094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 251/512] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:36:43 2022] DELETE /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:36:43.529174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:43.529810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:43.536497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.536981 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.537417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.538105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.538655 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.543243 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.628403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:43.674416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:43.682322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0f87b836-a48c-41e0-b366-7df33586e9a5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1513 microversion: 2.1 time: 0.156911 Aug 08 02:36:43.682916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 262/513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:43 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:43.843042 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:43.843732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:43.850240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.850751 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.851178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.851860 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.852308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.852725 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.983858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:43.991561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-344ae147-e93b-4057-86b9-719cc35a47e1 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.153198 Aug 08 02:36:43.992124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 252/514] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:43 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:44.703293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:44.703892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:44.710735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:44.711212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:44.711645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:44.712329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:44.712779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:44.713204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:44.839914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:44.847907 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4ac799c9-5168-4225-b22a-98fa8a1ebf83 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1513 microversion: 2.1 time: 0.148407 Aug 08 02:36:44.848463 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 263/515] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:44 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:36:45.012112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:45.012760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:45.018972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:45.019450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:45.019877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:45.020552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:45.020995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:45.021409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:45.150646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:45.157928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-134801eb-722a-4c19-ab73-0aceca13b7c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.149632 Aug 08 02:36:45.159054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 253/516] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:45 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:45.868275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:45.868889 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:45.875411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:45.875895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:45.876338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:45.877038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:45.878127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:45.878676 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:46.019547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:46.028377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cc8eabb8-2717-4536-bde9-933d926e9dee tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1513 microversion: 2.1 time: 0.163219 Aug 08 02:36:46.028989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 264/517] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:45 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:46.179477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:46.180198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:46.186282 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:46.186889 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:46.187330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:46.188078 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:46.188538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:46.188962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:46.369217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-65a4f1ec-64e6-4202-891f-abca7bafc1b6 req-85816e7f-8cb9-4e91-b34f-338f65190420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998bc6f6-7f4e-4219-ba48-4d047531c55c", "name": "network-vif-deleted", "tag": "06ece2e5-1c70-462c-91bf-e4c9507cc4d4"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:46.379640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-65a4f1ec-64e6-4202-891f-abca7bafc1b6 req-85816e7f-8cb9-4e91-b34f-338f65190420 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:46.380194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-65a4f1ec-64e6-4202-891f-abca7bafc1b6 req-85816e7f-8cb9-4e91-b34f-338f65190420 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:46.380709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-65a4f1ec-64e6-4202-891f-abca7bafc1b6 req-85816e7f-8cb9-4e91-b34f-338f65190420 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:46.391995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-65a4f1ec-64e6-4202-891f-abca7bafc1b6 req-85816e7f-8cb9-4e91-b34f-338f65190420 service nova] Creating event network-vif-deleted:06ece2e5-1c70-462c-91bf-e4c9507cc4d4 for instance 998bc6f6-7f4e-4219-ba48-4d047531c55c on hv-cinder-85226 Aug 08 02:36:46.396630 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:46.397186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-65a4f1ec-64e6-4202-891f-abca7bafc1b6 req-85816e7f-8cb9-4e91-b34f-338f65190420 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 Aug 08 02:36:46.398032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 265/518] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:46.404753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d8f4fb2f-a7db-4812-b96b-2ba9c8d98128 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.229251 Aug 08 02:36:46.405310 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 254/519] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:46 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:47.050288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:47.052669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:47.057685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:47.058157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:47.058628 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:47.059312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:47.059779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:47.060181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:47.089813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:47.090209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:47.090670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:47.091110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lazy-loading 'fault' on Instance uuid 998bc6f6-7f4e-4219-ba48-4d047531c55c {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:36:47.135487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:47.143102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6538f585-39de-4ba2-aa01-3c7ee8610db0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1308 microversion: 2.1 time: 0.097517 Aug 08 02:36:47.144032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 266/520] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:47 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:47.424866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:47.425481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:47.431548 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:47.432047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:47.432470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:47.433150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:47.433669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:47.434056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:47.568965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:47.576428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1109418b-0f1d-4d53-a4a4-0a9c91ffcc41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.155578 Aug 08 02:36:47.576981 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 255/521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:47 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:48.164352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:48.164966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:48.171314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.171792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.172227 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.172910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.173361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.173789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.203950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.204351 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.204779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.206109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lazy-loading 'fault' on Instance uuid 998bc6f6-7f4e-4219-ba48-4d047531c55c {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:36:48.246655 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:48.254605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bd447bd2-0b33-4581-ad7c-738a5caab37d tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 200 len: 1308 microversion: 2.1 time: 0.094038 Aug 08 02:36:48.255168 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 267/522] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:48 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:48.597528 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:48.598127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:48.604108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.604583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.605629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.606320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.606805 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.607231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.739701 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:48.747437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-07893a74-d0d1-4039-a218-a167907649de tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.153858 Aug 08 02:36:48.748013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 256/523] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:48 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:49.275145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:49.275694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 998bc6f6-7f4e-4219-ba48-4d047531c55c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:49.281908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:49.282441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:49.282873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:49.284212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:49.284688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:49.285107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:49.298167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] HTTP exception thrown: Instance 998bc6f6-7f4e-4219-ba48-4d047531c55c could not be found. Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Request method failure captured: Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c HTTP/1.1 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HZZkCXi2H-J05aHJCG8thJXzSev9FIu055eN8AsPhYJJja3LJAHncffTNoPbMOrUiHC5osmVlWyvAfdNeSySoFB8rQd9ktx0pNcHMTcbdMEDCySbJGFp71IGwxkNSklrJPjTDmCeDgbd0qU-nKCDtAuaFS1CGk7DBm1DNRQMSiQzN8 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 5ec7a76094c54d6c8e2517e254f44c16 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-900755294 Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:36:49.299874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotTestJSON-900755294 Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 5ec7a76094c54d6c8e2517e254f44c16 Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-900755294 Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotTestJSON-900755294-project Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f67323f672464220a38906660715a9d6 Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotTestJSON-900755294-project Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 998bc6f6-7f4e-4219-ba48-4d047531c55c could not be found. Aug 08 02:36:49.301480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '998bc6f6-7f4e-4219-ba48-4d047531c55c'} Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998bc6f6-7f4e-4219-ba48-4d047531c55c could not be found. Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:36:49.302484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998bc6f6-7f4e-4219-ba48-4d047531c55c could not be found. Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998bc6f6-7f4e-4219-ba48-4d047531c55c could not be found. Aug 08 02:36:49.303961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:36:49.305235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Returning 404 to user: Instance 998bc6f6-7f4e-4219-ba48-4d047531c55c could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:36:49.305235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1a43aefc-8659-4cb8-8268-7c169140bec1 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c" status: 404 len: 111 microversion: 2.1 time: 0.030070 Aug 08 02:36:49.305235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 268/524] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:49 2022] GET /compute/v2.1/servers/998bc6f6-7f4e-4219-ba48-4d047531c55c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:49.769289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:49.769951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:49.775812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:49.776283 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:49.776712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:49.777405 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:49.777859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:49.778295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:49.911717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:49.922707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-17eb3383-d42e-42ab-aef1-e5db7d96723d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.154963 Aug 08 02:36:49.922707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 257/525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:49 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:50.938910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:50.939544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:50.946422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:50.946896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:50.947333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:50.948016 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:50.948469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:50.948886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:51.083388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:51.090837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b3b1179e-b594-44ea-8b57-8fe2f3174f90 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.155688 Aug 08 02:36:51.091336 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 269/526] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:50 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:52.111447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:52.112057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:52.118771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:52.119271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:52.119703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:52.120385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:52.120836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:52.121255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:52.249411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:52.257330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2f384744-e768-449c-990a-334adc71d81b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.149738 Aug 08 02:36:52.257890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 258/527] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:52 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:53.278807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:53.279335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:53.286118 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:53.286648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:53.287075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:53.287755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:53.288201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:53.288620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:53.419239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:53.427141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c07f1369-12f2-47a1-92af-38b9dc59fc38 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.152299 Aug 08 02:36:53.427695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 270/528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:53 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:54.447373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:54.448008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:54.453956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:54.454464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:54.455145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:54.455821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:54.456278 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:54.456701 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:54.593520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:54.597083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:54.601675 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-867f2e9b-5efe-441f-b1b8-9c3552b8cab9 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.158134 Aug 08 02:36:54.602242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 259/529] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:54 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:55.629080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:55.629748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:55.636376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:55.636854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:55.637286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:55.637978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:55.638457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:55.638885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:55.766929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:55.775092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6ade0bbd-09a6-4d84-873d-e0e292954ea6 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.150476 Aug 08 02:36:55.775657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 271/530] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:55 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:56.708385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-a025c8f7-1391-436a-87e5-077f79d81716 req-ea51c6c3-0872-4740-a5b8-d42f5ef36e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "name": "network-vif-plugged", "status": "completed", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:56.718680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a025c8f7-1391-436a-87e5-077f79d81716 req-ea51c6c3-0872-4740-a5b8-d42f5ef36e2d service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:56.719157 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a025c8f7-1391-436a-87e5-077f79d81716 req-ea51c6c3-0872-4740-a5b8-d42f5ef36e2d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:56.719584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a025c8f7-1391-436a-87e5-077f79d81716 req-ea51c6c3-0872-4740-a5b8-d42f5ef36e2d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:56.731587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-a025c8f7-1391-436a-87e5-077f79d81716 req-ea51c6c3-0872-4740-a5b8-d42f5ef36e2d service nova] Creating event network-vif-plugged:2673af77-3e95-439c-83d1-409d6e88dcb5 for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 on hv-cinder-85226 Aug 08 02:36:56.736939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-a025c8f7-1391-436a-87e5-077f79d81716 req-ea51c6c3-0872-4740-a5b8-d42f5ef36e2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033388 Aug 08 02:36:56.737550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 260/531] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:56.795343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:56.795939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:56.802422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:56.802903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:56.803337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:56.804117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:56.804565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:56.804990 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:56.959351 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:56.967063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b4a01ca5-14d5-4dce-976c-fce5ae336f9a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.175532 Aug 08 02:36:56.967623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 272/532] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:56 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:36:57.989257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:57.989952 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:57.997111 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:57.997589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:57.998026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:57.998744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:57.999201 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:57.999623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:58.130428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:58.137818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0eb22961-82bc-4e10-a7a4-06408e068ab3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.153466 Aug 08 02:36:58.138397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 261/533] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:57 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:36:59.157310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:59.157823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:59.164412 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:59.164891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:59.165327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:59.166015 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:59.166494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:59.166923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:59.296753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:59.304833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-58f2f2d6-cd43-4b11-9f42-fce114c5ed0b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.151473 Aug 08 02:36:59.305405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 273/534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:59 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:00.325600 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:00.326241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:00.332925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:00.333396 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:00.333829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:00.334532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:00.334976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:00.335424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:00.470299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:00.478949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2c452f39-1bcb-4ddc-8845-6732c341163b tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.157235 Aug 08 02:37:00.479511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 262/535] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:00 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:01.499728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:01.500342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:01.507455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:01.507936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:01.508374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:01.509059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:01.509511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:01.509934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:01.642604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:01.646082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:01.650327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-65d2fa33-746e-4414-8bf6-6fcbd01a9561 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.154423 Aug 08 02:37:01.650910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 274/536] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:01 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:02.670806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:02.671457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:02.673427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:02.678746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:02.679350 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:02.679793 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:02.680586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:02.681049 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:02.681587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:02.813117 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:02.821511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d1867999-3477-4bbb-a455-f71640f7f2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1258 microversion: 2.1 time: 0.154551 Aug 08 02:37:02.822086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 263/537] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:02 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:02.858704 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1862982868", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "networks": [{"uuid": "235dc6e2-4294-4f34-bc7f-a3769150961e"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:02.912644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] validate_networks() for [('235dc6e2-4294-4f34-bc7f-a3769150961e', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:37:03.263210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:37:03.263635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:37:03.264146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:37:03.264558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:37:03.265003 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:37:03.274217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:03.274732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:03.276414 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:03.276414 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:03.276637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:03.276990 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:03.295306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Getting quotas for project 5ec7a76094c54d6c8e2517e254f44c16. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:37:03.299305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Getting quotas for user f67323f672464220a38906660715a9d6 and project 5ec7a76094c54d6c8e2517e254f44c16. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:37:03.311078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:37:03.313387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:37:03.428362 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-58b8fe9c-6db6-4ed0-ad43-dd5345c1fd75 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573425 Aug 08 02:37:03.429004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 275/538] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:37:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:37:03.439784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-28d3a405-297c-4254-b21a-053c95e04411 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:03.440419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-28d3a405-297c-4254-b21a-053c95e04411 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:03.494065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-28d3a405-297c-4254-b21a-053c95e04411 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:03.500620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-28d3a405-297c-4254-b21a-053c95e04411 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1219 microversion: 2.1 time: 0.064685 Aug 08 02:37:03.501184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 264/539] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:03 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:03.842505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:03.843126 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:03.850372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:03.850845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:03.851274 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:03.851952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:03.852399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:03.852818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:03.990156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:03.997802 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ebd7e57d-56da-4aa2-9fdc-32560e9c6cd8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1442 microversion: 2.1 time: 0.159245 Aug 08 02:37:03.998397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 276/540] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:03 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:04.019913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:04.020536 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:04.026484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:04.026959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:04.027384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:04.028066 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:04.028511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:04.028925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:04.166251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:04.173911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bb58cf76-2fd2-448f-a987-0c4935b04b29 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1442 microversion: 2.1 time: 0.158645 Aug 08 02:37:04.174511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 265/541] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:04 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:04.521685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:04.522296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:04.528337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:04.528818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:04.529308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:04.537990 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:04.542213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:04.542213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:04.607748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:04.615303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5a4289b1-f6a1-43c1-9ba1-7e69e31521af tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1215 microversion: 2.1 time: 0.098027 Aug 08 02:37:04.615898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 277/542] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:04 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:05.636594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:05.637241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:05.643294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:05.643775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:05.644213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:05.644941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:05.645333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:05.645748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:05.741177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:05.748412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2b6f232a-3990-42c5-9c57-06c7e7b325e9 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1277 microversion: 2.1 time: 0.115682 Aug 08 02:37:05.748979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 266/543] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:05 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:06.769137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:06.769868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:06.772378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:06.777064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.777620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.778122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.778850 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.779332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.790795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.930329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:06.938892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e294facb-47b6-40c4-ae45-8bdf26f9068f tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.173670 Aug 08 02:37:06.939694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 278/544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:06 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:06.951145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-79ccd2d3-354d-44b9-9d21-8eeef6d1ada9 req-f2fd81aa-d5df-4106-84ce-4367a18421b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:06.962651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-79ccd2d3-354d-44b9-9d21-8eeef6d1ada9 req-f2fd81aa-d5df-4106-84ce-4367a18421b6 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.963472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-79ccd2d3-354d-44b9-9d21-8eeef6d1ada9 req-f2fd81aa-d5df-4106-84ce-4367a18421b6 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.963899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-79ccd2d3-354d-44b9-9d21-8eeef6d1ada9 req-f2fd81aa-d5df-4106-84ce-4367a18421b6 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.976528 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-79ccd2d3-354d-44b9-9d21-8eeef6d1ada9 req-f2fd81aa-d5df-4106-84ce-4367a18421b6 service nova] Creating event network-changed:2673af77-3e95-439c-83d1-409d6e88dcb5 for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 on hv-cinder-85226 Aug 08 02:37:06.981968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-79ccd2d3-354d-44b9-9d21-8eeef6d1ada9 req-f2fd81aa-d5df-4106-84ce-4367a18421b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035008 Aug 08 02:37:06.982930 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 267/545] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:37:07.434282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:07.434851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:07.441670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.442261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.442796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.443578 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.444212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.444636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.471050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-903a58d7-7e3c-4531-9342-092e8d9ca83c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/ips" status: 200 len: 152 microversion: 2.20 time: 0.041039 Aug 08 02:37:07.475995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 279/546] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Aug 8 02:37:07 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:37:07.961045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:07.961736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:07.968031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.968505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.976263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.976263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.976263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.976263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:08.205415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:08.217196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2d60f6af-2b7d-48eb-8f73-bb0f345ad694 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.260686 Aug 08 02:37:08.217775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 268/547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:07 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:08.996787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-5ce9e8d0-dd58-46ba-ac9b-93fd7a10f948 req-6277e436-7844-43e0-b8ac-572ef474a42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c082cc7-e856-460a-afd9-fa97b329d81d", "tag": "f2e1be92-1e00-43fb-88a8-136ce824255c"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:09.006751 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-5ce9e8d0-dd58-46ba-ac9b-93fd7a10f948 req-6277e436-7844-43e0-b8ac-572ef474a42e service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:09.007226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-5ce9e8d0-dd58-46ba-ac9b-93fd7a10f948 req-6277e436-7844-43e0-b8ac-572ef474a42e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:09.007654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-5ce9e8d0-dd58-46ba-ac9b-93fd7a10f948 req-6277e436-7844-43e0-b8ac-572ef474a42e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:09.019022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-5ce9e8d0-dd58-46ba-ac9b-93fd7a10f948 req-6277e436-7844-43e0-b8ac-572ef474a42e service nova] Creating event network-changed:f2e1be92-1e00-43fb-88a8-136ce824255c for instance 8c082cc7-e856-460a-afd9-fa97b329d81d on hv-cinder-85226 Aug 08 02:37:09.024112 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-5ce9e8d0-dd58-46ba-ac9b-93fd7a10f948 req-6277e436-7844-43e0-b8ac-572ef474a42e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031076 Aug 08 02:37:09.024703 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 280/548] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:09.236755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:09.237508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:09.244308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:09.244848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:09.245286 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:09.245999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:09.246492 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:09.246962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:09.382327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:09.389794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4968af39-325e-4d9e-809a-f0e94be03f60 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.156811 Aug 08 02:37:09.390368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 269/549] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:09 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:10.412934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:10.413628 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:10.419762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.420373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.420811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.421499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.421953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.422406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.553328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:10.559273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-95c1c2e3-b24f-4eec-a2bb-ef64b0d1b9be tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.151764 Aug 08 02:37:10.559829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 281/550] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:10 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:10.787101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:10.787649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:10.793538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.794015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.794477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.795161 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.795609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.796027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.818614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lazy-loading 'flavor' on Instance uuid 406d6f4e-a119-4be3-82c0-61f8de65229a {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:37:11.228493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a5cac333-da11-4c71-8275-36191ebf891e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/action" status: 202 len: 0 microversion: 2.20 time: 0.445219 Aug 08 02:37:11.229084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 270/551] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 02:37:10 2022] POST /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:37:11.237184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:11.237787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:11.245303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.245775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.246207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.246916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.247364 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.247785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.378504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.386427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.387945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.389129 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-96fabf32-a85a-48de-9643-f99754f29c28 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.155776 Aug 08 02:37:11.389681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 282/552] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:11 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:37:11.581304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:11.581989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:11.588433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.588931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.589355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.590033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.590543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.590962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.719672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.727652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5aebb470-8532-474d-b91b-8f127dcb23fa tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.150857 Aug 08 02:37:11.728209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 271/553] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:11 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:12.411763 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:12.412378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:12.418742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:12.419206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:12.419644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:12.420352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:12.420836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:12.421262 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:12.554187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:12.563075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:12.564726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:12.565884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bad1f545-5ec0-4340-9731-0781b99029ca tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.158004 Aug 08 02:37:12.567916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 283/554] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:12 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:12.748404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:12.749009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:12.755741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:12.756228 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:12.756696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:12.757424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:12.757882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:12.758337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.046149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.055463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d07be927-e0f0-4ac5-b4e2-35435c1d3327 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.310864 Aug 08 02:37:13.056037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 272/555] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:12 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:13.589308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:13.589913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:13.591853 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:13.592510 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:13.597749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:13.600748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:13.600748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.600748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:13.600748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:13.601092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.730508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.738869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.740366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.741695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-67c0860c-4641-4e78-86ca-bc29bcb7eabd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.156273 Aug 08 02:37:13.742258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 284/556] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:13 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:14.076082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:14.076694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:14.078687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:14.083758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.084313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.084777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.085459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.085906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.086322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.218650 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.226302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-28e11a40-10b8-41eb-bee5-1ec31ecb2303 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.154089 Aug 08 02:37:14.227065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 273/557] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:14 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:14.765127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:14.765886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:14.773133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.773315 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-f9bb6aca-c7de-49d4-84d1-7a160663919b req-b623fa0d-98d0-43bf-9c1f-e45e2b1249ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c082cc7-e856-460a-afd9-fa97b329d81d", "name": "network-vif-plugged", "status": "completed", "tag": "f2e1be92-1e00-43fb-88a8-136ce824255c"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:14.773620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.774062 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.774790 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.775246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.775727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.783180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-f9bb6aca-c7de-49d4-84d1-7a160663919b req-b623fa0d-98d0-43bf-9c1f-e45e2b1249ef service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.783660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-f9bb6aca-c7de-49d4-84d1-7a160663919b req-b623fa0d-98d0-43bf-9c1f-e45e2b1249ef service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.784072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-f9bb6aca-c7de-49d4-84d1-7a160663919b req-b623fa0d-98d0-43bf-9c1f-e45e2b1249ef service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.795530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-f9bb6aca-c7de-49d4-84d1-7a160663919b req-b623fa0d-98d0-43bf-9c1f-e45e2b1249ef service nova] Creating event network-vif-plugged:f2e1be92-1e00-43fb-88a8-136ce824255c for instance 8c082cc7-e856-460a-afd9-fa97b329d81d on hv-cinder-85226 Aug 08 02:37:14.800456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-f9bb6aca-c7de-49d4-84d1-7a160663919b req-b623fa0d-98d0-43bf-9c1f-e45e2b1249ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Aug 08 02:37:14.801096 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 274/558] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:14.970433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.979521 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.981024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.982169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ace66301-37b4-4cc6-a0e6-66dd61688593 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.220961 Aug 08 02:37:14.982758 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 285/559] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:14 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:15.247942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:15.248660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:15.255647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.256134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.256554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.257224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.257670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.258086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.389893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:15.397795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7cb61939-ce00-45fe-a006-2a05b0a8bc3a tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.154043 Aug 08 02:37:15.398373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 275/560] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:15 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:16.004970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:16.005578 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:16.012058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.012547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.012984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.013686 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.014140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.014614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.148571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.156440 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.157958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.159153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3d68db1a-0532-4160-b0a9-3c824270489e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.158126 Aug 08 02:37:16.159709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 286/561] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:15 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:16.418135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:16.419001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:16.424948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.425419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.425851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.426638 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.427092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.427513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.555037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.562373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-84d85bdd-3cb6-45b6-a736-377f413a0f66 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1319 microversion: 2.1 time: 0.148032 Aug 08 02:37:16.562950 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 276/562] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:16 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:17.182938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:17.183517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:17.189905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.190417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.190856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.192104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.192833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.193263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.325251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.333580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.335134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.336282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-eda8119d-24de-4a15-9bc2-2e0860f6075f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.157413 Aug 08 02:37:17.336835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 287/563] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:17 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:17.584007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:17.584616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:17.590464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.590939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.591409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.592073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.592525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.592941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.611145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:17.724335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.731710 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bbe6491a-d159-40de-964d-e9e9558cd958 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1509 microversion: 2.1 time: 0.152261 Aug 08 02:37:17.732273 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 277/564] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:17 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:17.751873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42acaf6-3da9-4be6-83e0-611bb8b28827", "device": "/dev/sdb"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:17.754368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:17.760287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.760769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.761206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.761898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.762372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.762821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.360633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:18.361304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:18.367651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.368124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.368549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.369219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.369670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.370131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.436493 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f4e18d1a-0dc6-4758-96f5-83a39065608e tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "POST /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688504 Aug 08 02:37:18.437074 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 288/565] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:37:17 2022] POST /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:18.508759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:18.516699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:18.518179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:18.519381 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6625d225-414f-4c96-96b2-b92db39f53fa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.162624 Aug 08 02:37:18.520564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 278/566] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:18 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:37:19.545088 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:19.545730 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:19.552004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:19.557945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:19.557945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:19.557945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:19.557945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:19.558315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:19.682467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:19.690332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:19.692559 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:19.693740 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0002dbd0-49dd-479b-91c0-3e8809748fd6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.153506 Aug 08 02:37:19.694292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 289/567] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:19 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:20.716216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:20.716755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:20.723292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.723865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.724301 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.724988 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.725441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.725883 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.852655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:20.860520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:20.862020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:20.863338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bb007c5e-6de0-4f10-a586-57d194578c44 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.150907 Aug 08 02:37:20.863905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 279/568] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:20 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:21.987167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:21.987780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:21.994829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:21.995317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:21.995751 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:21.996436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:21.996883 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:21.997303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:22.053870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:37:22.054465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 02:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:37:22.127940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:22.136030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:22.137526 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:22.138737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8377d3dd-fb14-40de-92fe-b6d3779b6484 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.257254 Aug 08 02:37:22.139240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 290/569] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:21 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:23.161209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:23.161801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:23.167856 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:23.168328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:23.168753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:23.169427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:23.169872 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:23.170285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:23.303773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:23.311558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:23.313067 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:23.314201 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dbd9f45e-9822-470a-9be1-735e4c06caf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.157070 Aug 08 02:37:23.314774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 280/570] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:23 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:24.337791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:24.338414 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:24.344865 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:24.345348 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:24.345784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:24.346496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:24.346970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:24.347809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:24.479648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:24.483198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:24.488416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:24.491267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:24.491267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b62f03aa-5707-4e6e-8159-f2a036e8b024 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.157136 Aug 08 02:37:24.491615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 291/571] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:24 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:25.514539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:25.515145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:25.521842 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:25.522325 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:25.522779 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:25.523472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:25.523976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:25.524531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:25.656669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:25.664676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:25.666178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:25.667410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-29193deb-e261-44d9-9334-28a83ebe88f0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.156994 Aug 08 02:37:25.667966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 281/572] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:25 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:26.691179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:26.691919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:26.698784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:26.699263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:26.699699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:26.700390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:26.700836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:26.701260 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:26.832460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:26.840289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:26.841826 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:26.843037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2ccc9999-b234-499d-81c8-4bbe8245544e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.156355 Aug 08 02:37:26.843594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 292/573] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:26 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:27.867180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:27.867782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:27.873512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:27.873990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:27.874450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:27.875130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:27.875579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:27.875994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:28.079062 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:28.087502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:28.089012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:28.090152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94f8a4d7-ed8c-4e11-a81d-80adf379e859 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.227490 Aug 08 02:37:28.090752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 282/574] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:27 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:29.114425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:29.115094 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:29.122056 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:29.122565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:29.123008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:29.123699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:29.124154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:29.124582 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:29.257533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:29.265566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:29.267106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:29.268256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-eac837ed-3fc7-44c6-aa98-356e5a9d9568 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.158335 Aug 08 02:37:29.268811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 293/575] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:29 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:30.291246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:30.291854 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:30.297634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:30.298106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:30.298568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:30.299245 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:30.299696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:30.300112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:30.430716 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:30.438775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:30.440287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:30.442030 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e9ff10c4-569d-4c63-aeb8-193ef017c238 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.154089 Aug 08 02:37:30.442618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 283/576] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:30 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:31.465431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:31.466033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:31.472323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:31.472804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:31.473237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:31.473923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:31.474391 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:31.474815 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:31.601647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:31.609576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:31.611122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:31.612285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4003ead8-8f2f-4b91-8f94-3721da0033d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.150707 Aug 08 02:37:31.613462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 294/577] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:31 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:31.982494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-bb43a65f-edc1-4296-a07b-dedc13b67253 req-3bdc596b-d251-4d08-858f-4e4810ab4001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "name": "network-vif-plugged", "status": "completed", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:31.994823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-bb43a65f-edc1-4296-a07b-dedc13b67253 req-3bdc596b-d251-4d08-858f-4e4810ab4001 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:31.995406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-bb43a65f-edc1-4296-a07b-dedc13b67253 req-3bdc596b-d251-4d08-858f-4e4810ab4001 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:31.995939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-bb43a65f-edc1-4296-a07b-dedc13b67253 req-3bdc596b-d251-4d08-858f-4e4810ab4001 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:32.007679 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-bb43a65f-edc1-4296-a07b-dedc13b67253 req-3bdc596b-d251-4d08-858f-4e4810ab4001 service nova] Creating event network-vif-plugged:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:37:32.013525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-bb43a65f-edc1-4296-a07b-dedc13b67253 req-3bdc596b-d251-4d08-858f-4e4810ab4001 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035576 Aug 08 02:37:32.014246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 284/578] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:32.635495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:32.636110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:32.642492 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:32.642969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:32.643403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:32.644773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:32.645267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:32.645690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:32.773369 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:32.781164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:32.782690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:32.783842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6718b338-52b9-40dc-b95a-21e8bce55fd9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.152184 Aug 08 02:37:32.784403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 295/579] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:32 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:33.805965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:33.806709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:33.808644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=46 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:33.813604 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:33.814082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:33.814542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:33.815227 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:33.815673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:33.816743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:33.945995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:33.953961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:33.955919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:33.957640 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-50b5a1b0-9f71-4a3f-bf00-0b0b4bbdb566 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.155921 Aug 08 02:37:33.958184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 285/580] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:33 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:34.980031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:34.980636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:34.987076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:34.987554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:34.987986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:34.988668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:34.989137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:34.989558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:35.115754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:35.123532 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:35.124958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:35.126093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a307ae35-7558-4abb-a1d7-e831a8a9e357 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.149990 Aug 08 02:37:35.126686 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 296/581] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:34 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:36.149203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:36.149751 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:36.155664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:36.156131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:36.156554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:36.157226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:36.157668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:36.158081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:36.288013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:36.295950 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:36.297451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:36.298625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-04f395c9-5ac1-4b7d-8d57-d483215db538 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.153393 Aug 08 02:37:36.299382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 286/582] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:36 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:37.322460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:37.323078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:37.325350 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=38 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:37.330273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:37.330781 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:37.331216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:37.332010 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:37.332462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:37.332888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:37.461574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:37.469369 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:37.470902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:37.472052 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9d4f318c-3192-4d00-bf69-db7eb916c246 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.153663 Aug 08 02:37:37.472612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 297/583] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:37 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:38.494735 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:38.495338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:38.501333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:38.501807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:38.502240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:38.502948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:38.503947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:38.504373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:38.631932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:38.639733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:38.641230 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:38.642387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a56ddea1-d20d-479f-afbb-defb1bed17b9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.151513 Aug 08 02:37:38.642957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 287/584] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:38 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:39.666187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:39.666827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:39.673381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:39.673855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:39.674286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:39.675023 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:39.675945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:39.676394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:39.807211 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:39.815117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:39.817234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:39.819982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-61aaa81d-d2c8-4dbe-aeab-d220fdb7c0f2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.156115 Aug 08 02:37:39.819982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 298/585] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:39 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:40.841068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:40.841704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:40.848532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:40.849012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:40.849456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:40.850138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:40.850615 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:40.851043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:40.982182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:40.990509 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:40.992018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:40.993204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d2d97226-a20c-4999-86c7-ecd8c0bcc16b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.156010 Aug 08 02:37:40.993758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 288/586] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:40 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:42.014987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:42.015595 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:42.022756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:42.023165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:42.023624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:42.024318 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:42.024770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:42.025200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:42.155307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:42.163859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:42.165403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:42.166613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ed0052a-59eb-4663-901f-7787a330dec3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1746 microversion: 2.20 time: 0.155567 Aug 08 02:37:42.167157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 299/587] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:42 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:43.189395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:43.190016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:43.203691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:43.203895 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:43.205049 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:43.205917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:43.207141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:43.207712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:43.352519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:43.360903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:43.362426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:43.364452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-69a10322-1a01-4885-8d25-742a065f3daa tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.178898 Aug 08 02:37:43.365176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 289/588] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:43 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:44.395550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:44.396290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:44.403153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:44.403896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:44.404525 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:44.405554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:44.406307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:44.406932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:44.552327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:44.561529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:44.563312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:44.564732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-11e16815-901d-4f7b-b1cd-434ad2616830 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.173554 Aug 08 02:37:44.565391 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 300/589] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:44 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:45.591212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:45.592429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:45.599471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:45.599960 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:45.600397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:45.601100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:45.601553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:45.602150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:45.802773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:45.838197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:45.845459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:45.847967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3efc5de9-ddf1-4ef7-a099-b4906f018f74 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.259730 Aug 08 02:37:45.852058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 290/590] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:45 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:46.868120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:46.869355 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:46.876374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:46.876599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:46.876865 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:46.877834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:46.878547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:46.879193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:46.895823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:46.897230 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:46.903691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:46.904212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:46.904627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:46.905323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:46.905778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:46.906212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:47.060436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lazy-loading 'services' on Instance uuid 8c082cc7-e856-460a-afd9-fa97b329d81d {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:37:47.086704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:47.095440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:47.101297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:47.106403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6e4d07d7-66a7-4208-8090-5f63636fb16f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.214317 Aug 08 02:37:47.122467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 291/591] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:46 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:37:47.319698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-060d920e-f996-4081-91ab-53d0506788a6 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d/os-volume_attachments/e42acaf6-3da9-4be6-83e0-611bb8b28827" status: 202 len: 0 microversion: 2.1 time: 0.455989 Aug 08 02:37:47.320303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 301/592] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:37:46 2022] DELETE /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d/os-volume_attachments/e42acaf6-3da9-4be6-83e0-611bb8b28827 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:37:48.129662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:48.140443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:48.147690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:48.148200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:48.148654 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:48.149739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:48.150195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:48.150806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:48.155451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=83 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:48.296379 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:48.308752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:48.310391 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:48.311638 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-32ef6bc6-f343-4230-9fe8-3dc4e2bd3edc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.185920 Aug 08 02:37:48.312463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 292/593] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:48 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:49.339949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:49.340802 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:49.347091 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:49.347697 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:49.348206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:49.349007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:49.350132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:49.350658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:49.534385 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:49.544701 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:49.551206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:49.556380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:49.556553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:49.556658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0c2cba48-85b1-423b-9d69-7675cef9dde1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.217753 Aug 08 02:37:49.556658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 302/594] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:49 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:49.559399 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:49.559881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:49.560308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:49.561214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:49.561665 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:49.562291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:49.591737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:37:50.369477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2424a663-d4cf-4672-ad1f-05ece17d62d7 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 204 len: 0 microversion: 2.1 time: 0.821655 Aug 08 02:37:50.373483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 293/595] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:37:49 2022] DELETE /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:37:50.378634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:50.379269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:50.387373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:50.388130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:50.388746 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:50.389645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:50.390105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:50.390590 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:50.578320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:50.585975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:50.586752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:50.591247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-16cecbaf-014b-422e-a351-79aca05c8118 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1515 microversion: 2.1 time: 0.216578 Aug 08 02:37:50.592351 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 303/596] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:50 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:37:50.593606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:50.594132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:50.594655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:50.595362 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:50.595816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:50.596261 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:50.741621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:50.752133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:50.756000 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:50.757288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3a82b192-18d2-401d-a034-d29e93bad3a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.183020 Aug 08 02:37:50.757845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 294/597] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:50 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:51.613656 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:51.614423 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:51.621567 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:51.622058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:51.622530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:51.623431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:51.624085 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:51.624552 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:51.775093 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:51.785104 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:51.788351 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:51.800181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3da0fac6-da69-4b12-a220-063f31eb84f0 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1515 microversion: 2.1 time: 0.190048 Aug 08 02:37:51.821418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 304/598] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:51 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:51.821648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:51.821648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:51.821648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:51.821903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:51.822132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:51.822916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:51.981307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:51.989873 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:51.992062 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:51.993463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2709d1fb-127a-4da5-b938-3086a914ffcc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.213061 Aug 08 02:37:51.994012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 295/599] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:51 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:37:52.829947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:52.830844 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:52.840514 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:52.841068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:52.841509 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:52.842200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:52.842673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:52.843389 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:52.992379 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:53.000110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0c684a8a-d3c7-4c7b-9311-9a077565f4c5 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1515 microversion: 2.1 time: 0.174479 Aug 08 02:37:53.001134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 305/600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:52 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:53.016958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:53.017699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:53.026169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:53.026611 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:53.027039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:53.027721 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:53.028170 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:53.028586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:53.166339 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:53.174236 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:53.175763 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:53.176909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-611f740c-0375-48dc-aad3-95cd319e54bb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.163877 Aug 08 02:37:53.177530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 296/601] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:53 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:54.021758 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:54.022592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:54.028652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:54.029133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:54.029574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:54.030275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:54.030766 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:54.031194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:54.177591 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:54.184987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d7a959e7-84ea-4bc3-bd26-92c711573e3c tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1515 microversion: 2.1 time: 0.167675 Aug 08 02:37:54.185564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 306/602] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:54 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:54.200853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:54.201472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:54.207770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:54.208289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:54.209644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:54.210370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:54.210870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:54.211319 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:54.412768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:54.420720 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:54.422210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:54.423380 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-def96d43-3ad4-44de-8769-788ab89cc771 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.226695 Aug 08 02:37:54.437940 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 297/603] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:54 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:54.722928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-901c61ce-32dd-480b-8a3e-b241469937c1 req-3e51cd89-aca4-4dce-a0e5-aa027fc03607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c082cc7-e856-460a-afd9-fa97b329d81d", "name": "network-vif-deleted", "tag": "f2e1be92-1e00-43fb-88a8-136ce824255c"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:54.734512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-901c61ce-32dd-480b-8a3e-b241469937c1 req-3e51cd89-aca4-4dce-a0e5-aa027fc03607 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:54.735272 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-901c61ce-32dd-480b-8a3e-b241469937c1 req-3e51cd89-aca4-4dce-a0e5-aa027fc03607 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:54.735892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-901c61ce-32dd-480b-8a3e-b241469937c1 req-3e51cd89-aca4-4dce-a0e5-aa027fc03607 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:54.748833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-901c61ce-32dd-480b-8a3e-b241469937c1 req-3e51cd89-aca4-4dce-a0e5-aa027fc03607 service nova] Creating event network-vif-deleted:f2e1be92-1e00-43fb-88a8-136ce824255c for instance 8c082cc7-e856-460a-afd9-fa97b329d81d on hv-cinder-85226 Aug 08 02:37:54.754822 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-901c61ce-32dd-480b-8a3e-b241469937c1 req-3e51cd89-aca4-4dce-a0e5-aa027fc03607 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098882 Aug 08 02:37:54.756012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 307/604] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:55.208076 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:55.209397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:55.215738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:55.216244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:55.216714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:55.217632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:55.218188 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:55.218672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:55.250936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:55.251444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:55.251876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:55.252320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lazy-loading 'fault' on Instance uuid 8c082cc7-e856-460a-afd9-fa97b329d81d {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:37:55.300995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67323f672464220a38906660715a9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7a76094c54d6c8e2517e254f44c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:55.308599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1f21475b-9b26-450d-8e41-9a3b9b81d126 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 200 len: 1309 microversion: 2.1 time: 0.105342 Aug 08 02:37:55.309171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 298/605] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:55 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:55.447404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:55.448098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:55.454272 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:55.455033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:55.455463 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:55.456150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:55.456596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:55.457013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:55.479352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:55.600632 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:55.608599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:55.610136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:55.611312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6fb89c71-adae-4d53-8afa-d4a023df16ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.168754 Aug 08 02:37:55.611983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 308/606] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:55 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:56.328416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:56.329058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] [instance: 8c082cc7-e856-460a-afd9-fa97b329d81d] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:56.335258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:56.335736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:56.336169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:56.336881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:56.337333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:56.337757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:56.351692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] HTTP exception thrown: Instance 8c082cc7-e856-460a-afd9-fa97b329d81d could not be found. Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Request method failure captured: Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d HTTP/1.1 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HZZkCXi2H-J05aHJCG8thJXzSev9FIu055eN8AsPhYJJja3LJAHncffTNoPbMOrUiHC5osmVlWyvAfdNeSySoFB8rQd9ktx0pNcHMTcbdMEDCySbJGFp71IGwxkNSklrJPjTDmCeDgbd0qU-nKCDtAuaFS1CGk7DBm1DNRQMSiQzN8 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 5ec7a76094c54d6c8e2517e254f44c16 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-900755294 Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:37:56.353338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5ec7a76094c54d6c8e2517e254f44c16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-VolumesSnapshotTestJSON-900755294 Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 5ec7a76094c54d6c8e2517e254f44c16 Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-900755294 Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-VolumesSnapshotTestJSON-900755294-project Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f67323f672464220a38906660715a9d6 Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-VolumesSnapshotTestJSON-900755294-project Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 8c082cc7-e856-460a-afd9-fa97b329d81d could not be found. Aug 08 02:37:56.354755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '8c082cc7-e856-460a-afd9-fa97b329d81d'} Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c082cc7-e856-460a-afd9-fa97b329d81d could not be found. Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:56.355502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c082cc7-e856-460a-afd9-fa97b329d81d could not be found. Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c082cc7-e856-460a-afd9-fa97b329d81d could not be found. Aug 08 02:37:56.356961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:37:56.358246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] Returning 404 to user: Instance 8c082cc7-e856-460a-afd9-fa97b329d81d could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:56.358246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b307f081-4c5d-488f-90f5-b528f77af4c4 tempest-VolumesSnapshotTestJSON-900755294 tempest-VolumesSnapshotTestJSON-900755294-project] 10.222.0.15 "GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d" status: 404 len: 111 microversion: 2.1 time: 0.030132 Aug 08 02:37:56.358246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 299/607] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:56 2022] GET /compute/v2.1/servers/8c082cc7-e856-460a-afd9-fa97b329d81d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:56.634738 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:56.639453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:56.641673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:56.642147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:56.642626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:56.643316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:56.643767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:56.644191 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:56.776004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:56.784219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:56.788456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:56.788456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fa61879d-7fc5-4620-9ed5-af27d686462a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1741 microversion: 2.20 time: 0.156243 Aug 08 02:37:56.788456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 309/608] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:56 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:57.810308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:57.810941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:57.816954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:57.817473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:57.817910 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:57.818921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:57.819417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:57.819842 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:57.947969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:57.956144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:57.957655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:57.958838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-970685ed-ea47-4a65-b17a-3c1b758d113a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1723 microversion: 2.20 time: 0.152474 Aug 08 02:37:57.959768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 300/609] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:57 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:58.982851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:58.983483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:58.989876 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:58.991547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:58.991989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:58.992674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:58.993267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:58.993690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:59.127523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:59.136427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:59.137876 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:59.139052 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dd730b3f-af99-45be-9c98-0272968844f1 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1723 microversion: 2.20 time: 0.160116 Aug 08 02:37:59.139624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 310/610] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:58 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:00.063472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-7c0585b3-ecf8-4a5f-8331-549a9c35d551 req-35d12a63-e3fd-45c2-964f-121dbc8ef6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "name": "network-vif-unplugged", "status": "completed", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:00.073235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-7c0585b3-ecf8-4a5f-8331-549a9c35d551 req-35d12a63-e3fd-45c2-964f-121dbc8ef6e1 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:00.073709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-7c0585b3-ecf8-4a5f-8331-549a9c35d551 req-35d12a63-e3fd-45c2-964f-121dbc8ef6e1 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:00.074166 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-7c0585b3-ecf8-4a5f-8331-549a9c35d551 req-35d12a63-e3fd-45c2-964f-121dbc8ef6e1 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:00.086146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-7c0585b3-ecf8-4a5f-8331-549a9c35d551 req-35d12a63-e3fd-45c2-964f-121dbc8ef6e1 service nova] Creating event network-vif-unplugged:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:38:00.091040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-7c0585b3-ecf8-4a5f-8331-549a9c35d551 req-35d12a63-e3fd-45c2-964f-121dbc8ef6e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031359 Aug 08 02:38:00.093497 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 301/611] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:00.165176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:00.165840 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:00.172282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:00.172768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:00.173205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:00.173903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:00.174402 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:00.174800 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:00.310363 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:00.318234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:00.320410 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:00.321563 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-053548b8-74df-45d8-9c76-26767646b5cf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1726 microversion: 2.20 time: 0.163872 Aug 08 02:38:00.322119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 311/612] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:00 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:00.344344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b136508-005b-42e2-a8df-0937c4548ddd"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:00.346961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:00.353210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:00.353690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:00.354126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:00.354847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:00.355303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:00.355728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:01.274313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-14c3e301-45c3-488d-b876-bfd2c9ef9b3f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.934254 Aug 08 02:38:01.274965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 302/613] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Aug 8 02:38:00 2022] POST /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments => generated 188 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:38:01.397246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:01.397839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:01.404773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:01.405257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:01.405693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:01.406402 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:01.406863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:01.407292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:01.491482 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124659) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 02:38:01.745708 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-17073d17-2838-4d10-8d41-11dff1a62884 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/action" status: 202 len: 0 microversion: 2.20 time: 0.352258 Aug 08 02:38:01.746305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 312/614] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 02:38:01 2022] POST /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:38:01.754470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:01.755073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:01.762170 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:01.762678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:01.763107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:01.763793 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:01.764240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:01.764709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:01.902476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:01.911129 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:01.912569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:01.913746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8d5254c7-8221-43e3-b7ef-941d4a73cdf0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1812 microversion: 2.20 time: 0.163260 Aug 08 02:38:01.914476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 303/615] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:01 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:02.939456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:02.940068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:02.945915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:02.946426 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:02.946867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:02.948138 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:02.948845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:02.949209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:03.086512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:03.096323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:03.097830 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:03.099066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b0cef4e1-a82c-4654-831a-76b654c9222d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1752 microversion: 2.20 time: 0.164099 Aug 08 02:38:03.099833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 313/616] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:02 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:04.122432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:04.123037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:04.124981 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:04.129522 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:04.129991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:04.130443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:04.131123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:04.131602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:04.132017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:04.262605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:04.270754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:04.272235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:04.273373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-595ee2c8-2af7-492c-ad91-57f6ec0ca8a5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1752 microversion: 2.20 time: 0.154915 Aug 08 02:38:04.273919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 304/617] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:04 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:38:05.296315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:05.296924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:05.303323 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:05.303810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:05.304282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:05.304967 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:05.305419 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:05.305843 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:05.434839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:05.443234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:05.444710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:05.445842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-197fadf9-3b6f-48f6-90fb-b05ebedc119b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1754 microversion: 2.20 time: 0.153452 Aug 08 02:38:05.446415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 314/618] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:05 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:06.469438 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:06.469971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:06.475996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:06.476467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:06.476890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:06.477566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:06.478010 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:06.478465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:06.493382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:06.678903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:06.688868 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:06.690413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:06.691546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-92f3562b-a3de-4510-9e76-5af5787bef93 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.226177 Aug 08 02:38:06.692104 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 305/619] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:06 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:07.715810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:07.716416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:07.718817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:07.723623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:07.730202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:07.730202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:07.730202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:07.730202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:07.731536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:07.863845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:07.872115 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:07.873692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:07.874920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e8465996-50fd-4e27-8265-54206817b122 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.163447 Aug 08 02:38:07.875491 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 315/620] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:07 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:08.897034 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:08.899124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:08.904812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:08.905292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:08.905740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:08.906547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:08.907008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:08.907434 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:09.048001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:09.056787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:09.059429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:09.060768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e0c72984-d453-473b-87c2-3bca763e14ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.167636 Aug 08 02:38:09.061483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 306/621] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:08 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:38:10.088040 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:10.090371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:10.096987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:10.097597 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:10.098224 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:10.099007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:10.099530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:10.100021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:10.236948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:10.246218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:10.247750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:10.248900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-28977d84-31fc-47c8-aa35-9d339d474ac2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.167093 Aug 08 02:38:10.249454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 316/622] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:10 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:11.271314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:11.271909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:11.278138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:11.278652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:11.279081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:11.279759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:11.280202 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:11.280616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:11.419031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:11.427841 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:11.429510 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:11.430850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ff31e89f-3fbe-4bb5-b56f-cb6ab499054d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.163324 Aug 08 02:38:11.431525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 307/623] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:11 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:12.454226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:12.455136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:12.461714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:12.462275 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:12.462741 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:12.464022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:12.464595 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:12.465050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:12.603998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:12.612630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:12.614125 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:12.615291 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08414d4e-8826-48fe-8936-446ddb142713 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.165018 Aug 08 02:38:12.615846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 317/624] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:12 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:13.638727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:13.639401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:13.645256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:13.645763 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:13.646185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:13.646895 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:13.647341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:13.647761 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:13.782740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:13.791364 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:13.792847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:13.794840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-34d8a7cf-8387-4bd4-8e68-80ad16b4cb57 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.160172 Aug 08 02:38:13.795462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 308/625] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:13 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:14.817254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:14.817856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:14.823961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:14.824434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:14.825381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:14.826063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:14.826543 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:14.826970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:14.956599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:14.964834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:14.966997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:14.968234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6f8592c4-7e3d-4a40-8e75-e3efe6050408 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.155066 Aug 08 02:38:14.968785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 318/626] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:14 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:15.991145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:16.050079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:16.050079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:16.050079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:16.050079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:16.050563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:16.050563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:16.050563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:16.135403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:16.144596 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:16.147666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:16.147666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-19ce0663-724a-42bf-b346-fd53896ebc2e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.160196 Aug 08 02:38:16.147946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 309/627] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:15 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:17.171427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:17.171969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:17.178271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:17.178756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:17.179187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:17.179862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:17.180308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:17.180726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:17.328280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:17.337690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:17.339313 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:17.341397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6be9f989-723e-470c-ae10-fa5f6da33b59 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.174906 Aug 08 02:38:17.342090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 319/628] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:17 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:18.366488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:18.367090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:18.373621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:18.374100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:18.374562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:18.375250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:18.375705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:18.376128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:18.509843 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:18.518994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:18.527102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:18.527102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-52f5f6da-4c52-46e2-9b76-d516ea93edb9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.159111 Aug 08 02:38:18.527102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 310/629] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:18 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:19.545090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:19.545793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:19.552387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:19.552866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:19.553296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:19.553976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:19.554444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:19.554885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:19.684096 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:19.692408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:19.693919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:19.695105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1d3a728a-e88b-46f9-b64e-3af5f6d476d7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.154934 Aug 08 02:38:19.695668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 320/630] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:19 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:20.718504 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:20.719138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:20.725198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:20.725678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:20.726107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:20.726821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:20.727277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:20.727700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:20.864425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:20.873670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:20.875196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:20.876370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8eb9d6d7-bfb2-4577-8e7e-02cbb68de267 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.161891 Aug 08 02:38:20.876929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 311/631] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:20 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:21.899271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:21.899875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:21.907584 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:21.908146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:21.908703 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:21.909520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:21.910027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:21.910653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:22.041505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:22.050505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:22.052012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:22.053414 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec021247-7d26-4b5a-a550-a36287bd6737 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.157996 Aug 08 02:38:22.053970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 321/632] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:21 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:23.077236 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:23.077851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:23.089833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:23.091570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:23.092151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:23.092859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:23.093307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:23.093725 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:23.232189 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:23.241303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:23.242874 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:23.244040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9aad4ed7-ddb7-4b0a-9f94-205e6c4e01c2 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.171363 Aug 08 02:38:23.244698 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 312/633] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:23 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:24.268205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:24.268931 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:24.276835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:24.277327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:24.278082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:24.278840 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:24.279345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:24.285724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:24.416973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:24.426249 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:24.428045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:24.429243 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ed0c4f94-4b5a-4d77-ba24-b54e8dfe5933 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.165465 Aug 08 02:38:24.430000 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 322/634] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:24 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:25.452342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:25.452990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:25.458943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:25.459416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:25.459847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:25.460557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:25.461003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:25.461416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:25.593740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:25.602113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:25.603638 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:25.608417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d0014aa6-f7f9-42cc-a1cd-bd6b765d6b46 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.156491 Aug 08 02:38:25.608417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 313/635] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:25 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:38:26.628519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:26.629122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:26.636345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:26.637504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:26.638043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:26.638778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:26.639239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:26.639669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:26.642277 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:26.768104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:26.776516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:26.778101 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:26.779306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-82139b5f-daa7-45d2-97fa-97fe35680b81 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.154709 Aug 08 02:38:26.779824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 323/636] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:26 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:27.802406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:27.802944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:27.808872 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:27.809346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:27.809767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:27.810458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:27.810903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:27.811315 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:27.945083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:27.954166 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:27.955922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:27.957059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5579ca71-2937-43c3-a6c0-5e0609b2363b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.158650 Aug 08 02:38:27.957607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 314/637] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:27 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:28.980175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:28.980895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:28.987346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:28.987813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:28.988251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:28.988943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:28.989394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:28.989817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:29.116658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:29.125532 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:29.127071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:29.128216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7112636f-a699-4f7e-8c2a-93d06b62678c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.151985 Aug 08 02:38:29.128778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 324/638] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:28 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:30.151571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:30.153007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:30.159572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:30.160041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:30.160466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:30.161142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:30.161585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:30.161999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:30.295890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:30.304199 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:30.305682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:30.306861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e41d7259-b66f-4fac-8cb9-46438fc8d7d4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.159787 Aug 08 02:38:30.307416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 315/639] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:30 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:31.330057 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:31.330699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:31.337172 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:31.337652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:31.338092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:31.338816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:31.339273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:31.339736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:31.471445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:31.479961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:31.482133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:31.483306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5d455e0e-453b-42b9-a015-9356be444c26 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.157418 Aug 08 02:38:31.483870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 325/640] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:31 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:32.506722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:32.507446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:32.513890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:32.514374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:32.514806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:32.515487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:32.515930 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:32.516348 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:32.645478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:32.653851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:32.656690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:32.656690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-63b83042-8582-4bbe-bb78-d79b81af5d76 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.153825 Aug 08 02:38:32.657148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 316/641] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:32 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:33.679498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:33.680091 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:33.686559 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:33.687100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:33.687537 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:33.688228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:33.688677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:33.689109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:33.816843 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:33.826063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:33.827644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:33.828794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0ff77265-4e79-4d39-983f-827f1835e4f7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.153543 Aug 08 02:38:33.829345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 326/642] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:33 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:34.852585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:34.853185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:34.855139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=26 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:34.860585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:34.862043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:34.862043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:34.862265 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:34.862699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:34.863123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:34.997056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:35.005451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:35.006979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:35.008130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dd5c3e46-68b4-471d-90f6-503c27bbabe9 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.159457 Aug 08 02:38:35.008682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 317/643] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:34 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:36.032228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:36.032928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:36.040353 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:36.043360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:36.043360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:36.043360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:36.043360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:36.044205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:36.181177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:36.188844 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:36.190427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:36.191600 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a456838c-7481-44dc-bda3-46ec7ca5b453 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.164271 Aug 08 02:38:36.192167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 327/644] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:36 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:37.217054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:37.217054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:37.224297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:37.224957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:37.225506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:37.226620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:37.227192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:37.227752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:37.230953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=76 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:37.381020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:37.390196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:37.391736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:37.392879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-be6e3a49-77ad-4bc6-97db-45981e05262c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.181566 Aug 08 02:38:37.393429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 318/645] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:37 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:38.417157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:38.417762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:38.419777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=26 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:38.424361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:38.424836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:38.425267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:38.425943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:38.426422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:38.426839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:38.555458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:38.564486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:38.566014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:38.567201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f17fab8c-94a6-49ab-8409-abc5b4aa0330 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.154140 Aug 08 02:38:38.567767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 328/646] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:38 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:38.828131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-115c2101-22e5-4497-9b17-1ee88b4465fa req-c62dbab1-27a9-4160-903e-554bc8fd59e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "name": "network-vif-plugged", "status": "completed", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:38.837682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-115c2101-22e5-4497-9b17-1ee88b4465fa req-c62dbab1-27a9-4160-903e-554bc8fd59e1 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:38.843937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-115c2101-22e5-4497-9b17-1ee88b4465fa req-c62dbab1-27a9-4160-903e-554bc8fd59e1 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:38.843937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-115c2101-22e5-4497-9b17-1ee88b4465fa req-c62dbab1-27a9-4160-903e-554bc8fd59e1 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:38.849275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-115c2101-22e5-4497-9b17-1ee88b4465fa req-c62dbab1-27a9-4160-903e-554bc8fd59e1 service nova] Creating event network-vif-plugged:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:38:38.854200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-115c2101-22e5-4497-9b17-1ee88b4465fa req-c62dbab1-27a9-4160-903e-554bc8fd59e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205025 Aug 08 02:38:38.854819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 319/647] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:39.591416 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:39.592020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:39.598455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:39.598944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:39.599383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:39.600077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:39.600531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:39.600958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:39.703039 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:39.705528 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:39.712020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:39.712811 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:39.713061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:39.713949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:39.714610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:39.715230 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:39.731930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:39.740558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:39.742051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:39.743262 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d7ee4c70-1d4a-4b31-856e-f53cc5848311 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.156921 Aug 08 02:38:39.743813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 329/648] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:39 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:39.957261 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e34ad98d-db94-4ff8-863c-cecdf5cb026a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/action" status: 202 len: 0 microversion: 2.1 time: 0.259509 Aug 08 02:38:39.958048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 320/649] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:38:39 2022] POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:38:39.966077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:39.966749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:39.972762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:39.973274 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:39.973715 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:39.974435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:39.974885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:39.975307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:40.121344 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:40.129962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fc000a3e-a9dc-4f05-bd90-57ccb0f72586 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1750 microversion: 2.1 time: 0.167853 Aug 08 02:38:40.130549 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 330/650] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:39 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:40.766834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:40.767515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:40.773760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:40.774244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:40.774704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:40.775393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:40.775848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:40.776271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:40.910698 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:40.920408 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:40.921911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:40.923220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-03fb80c8-e2fe-4fc5-8139-563d620999f3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.160938 Aug 08 02:38:40.923769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 321/651] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:40 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:41.153895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:41.154731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:41.161024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:41.161502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:41.161935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:41.162643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:41.163102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:41.163549 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:41.303569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:41.311403 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-43f0bd37-792a-4282-84d0-e46dbc3900e8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1750 microversion: 2.1 time: 0.161930 Aug 08 02:38:41.311975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 331/652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:41 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:41.428076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:38:41.428289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 02:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:38:41.945865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:41.946498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:41.954300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:41.955074 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:41.955505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:41.956190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:41.956639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:41.957059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:42.086191 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:42.094823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:42.096345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:42.097487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-52f020a1-9bf7-4a5f-88f5-897d012bac15 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.155551 Aug 08 02:38:42.098043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 322/653] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:41 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:38:42.332986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:42.333605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:42.340016 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:42.341044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:42.341489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:42.342185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:42.342687 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:42.343120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:42.501824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:42.509807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-80a8badb-2d3b-4d00-902f-c1ae6fc40409 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.180835 Aug 08 02:38:42.510375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 332/654] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:42 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:43.121023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:43.121658 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:43.128629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:43.129153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:43.129588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:43.130282 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:43.130770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:43.131191 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:43.290597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:43.290597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:43.290905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:43.292044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3c3da820-ff36-4953-ba06-cd5b3eef0505 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1810 microversion: 2.20 time: 0.174960 Aug 08 02:38:43.292601 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 323/655] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:43 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:43.531704 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:43.532593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:43.539221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:43.539698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:43.540131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:43.540812 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:43.541258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:43.541702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:43.693393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:43.702690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-55a5f198-3b54-41d2-ad22-ac0b08a16ab5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.174798 Aug 08 02:38:43.703253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 333/656] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:43 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:44.316214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:44.316812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:44.322676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:44.323145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:44.323569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:44.324235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:44.324676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:44.326071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:44.453471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:44.461943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:44.463444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:44.464594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dd5f1402-faa1-40fc-9ea2-4adf9eb4e400 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1797 microversion: 2.20 time: 0.152225 Aug 08 02:38:44.465139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 324/657] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:44 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1797 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:44.724658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:44.725264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:44.731700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:44.732173 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:44.732605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:44.733290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:44.733737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:44.734153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:44.881919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:44.889960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ccfd531a-4bfc-4422-8dca-ebf5c18e5ad8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.169055 Aug 08 02:38:44.890561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 334/658] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:44 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:45.911216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:45.911827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:45.917905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:45.918406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:45.923256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:45.923256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:45.923256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:45.923256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:46.075704 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:46.083983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e65c0927-421f-481f-bd28-cec7d4a1d498 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.176606 Aug 08 02:38:46.084796 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 325/659] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:45 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:47.104972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:47.105636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:47.112646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:47.113124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:47.113561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:47.114252 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:47.114742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:47.115167 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:47.254526 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:47.262816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e37e5dcd-1a82-4f63-a444-e736c4f726d2 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.161153 Aug 08 02:38:47.263404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 335/660] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:47 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:48.284384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:48.284921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:48.290717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:48.291190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:48.291644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:48.292317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:48.292762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:48.293177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:48.434801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:48.442636 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f050fa1c-37e2-4938-a847-d503715f65ea tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.162087 Aug 08 02:38:48.443205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 326/661] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:48 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:49.464187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:49.464790 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:49.471192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:49.471661 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:49.472092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:49.472768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:49.473215 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:49.473634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:49.613315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:49.621278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2196a87e-5338-463f-b8e0-0f0f0a03cb69 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.161016 Aug 08 02:38:49.622489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 336/662] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:49 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:50.644300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:50.644908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:50.650862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:50.651342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:50.651774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:50.652456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:50.652907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:50.653329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:50.793701 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:50.802589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-354275df-ed30-4f74-9126-5e0815324846 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.162050 Aug 08 02:38:50.803167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 327/663] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:50 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:51.824146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:51.824755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:51.831813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:51.832289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:51.832724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:51.833479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:51.833933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:51.834373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:51.979006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:51.986998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d6f594a4-d830-4109-baff-bbf3bca69d59 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.166656 Aug 08 02:38:51.987599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 337/664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:51 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:53.008099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:53.008714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:53.014968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.016524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.016524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.016732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.017086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.017502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.170996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:53.179669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94b4f71a-9e81-4c63-bfc1-3d26d01c00e5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1755 microversion: 2.1 time: 0.175334 Aug 08 02:38:53.180289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 328/665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:53 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:54.201278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:54.202009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:54.208742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:54.209212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:54.209642 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:54.210316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:54.210788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:54.211208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:54.354198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:54.362846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-51c09851-85bb-4859-b6cb-43043d5f10d8 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1758 microversion: 2.1 time: 0.165661 Aug 08 02:38:54.363411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 338/666] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:54 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:05.604689 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:05.605299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:05.608017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=23 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:05.608706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:05.613359 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:05.613830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:05.614252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:05.614982 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:05.615484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:05.620398 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:05.638515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4167781e-1209-4148-845d-5e4ffb779108 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/ips" status: 200 len: 146 microversion: 2.1 time: 0.037674 Aug 08 02:39:05.639150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 329/667] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:39:05 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:39:09.155973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92706c9e-845d-4fc1-8a81-2e5e6937aab0"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:09.158494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:09.160486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=21 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:09.161158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:09.165765 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:09.166244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:09.166714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:09.167404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:09.167904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:09.168288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:09.869369 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a39f0b26-891c-4083-8689-5b22f0b69655 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.718235 Aug 08 02:39:09.869978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 339/668] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:39:09 2022] POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:39:15.315852 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23f48dfd-82f4-43f8-8d50-3d482421dc8d"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:15.318266 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:15.324195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:15.324675 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:15.325103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:15.325791 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:15.326498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:15.332079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:15.993013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d36f1525-b922-4103-ba80-9e5c25c12986 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784587 Aug 08 02:39:15.993621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 330/669] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:39:15 2022] POST /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:39:18.443569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0199a0bf-054b-4829-81e8-23f432be58db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:18.449696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0199a0bf-054b-4829-81e8-23f432be58db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.450179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0199a0bf-054b-4829-81e8-23f432be58db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:18.450647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0199a0bf-054b-4829-81e8-23f432be58db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:18.510089 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0199a0bf-054b-4829-81e8-23f432be58db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Going to try to stop instance {{(pid=124659) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 02:39:18.691469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0199a0bf-054b-4829-81e8-23f432be58db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action" status: 202 len: 0 microversion: 2.1 time: 0.252474 Aug 08 02:39:18.691992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 340/670] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:39:18 2022] POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:39:18.701764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:18.704311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:18.709256 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.709870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:18.710327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:18.711047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.711508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:18.711931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:18.844358 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:18.852255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-19da3f8e-13c0-4e3c-9dc7-0cc24373d4c8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.155802 Aug 08 02:39:18.852819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 331/671] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:18 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:19.873311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:19.874041 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:19.880666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:19.881136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:19.881568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:19.882274 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:19.882754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:19.883173 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:20.014269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:20.022372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b0968379-de91-486e-a066-3508833a6e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.153439 Aug 08 02:39:20.022952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 341/672] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:19 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:21.044209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:21.045449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:21.051843 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:21.052314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:21.052738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:21.053409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:21.053881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:21.054293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:21.189373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:21.197235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4f1146fa-89aa-435e-b6d9-13055c1536b9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.156834 Aug 08 02:39:21.197802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 332/673] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:21 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:22.220400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:22.220400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:22.225486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:22.225958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:22.226459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:22.227163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:22.227606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:22.228024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:22.355324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:22.363794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c0d99130-05d2-4fa7-aae8-9406c1753c6b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.149322 Aug 08 02:39:22.364359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 342/674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:22 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:23.385305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:23.385937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:23.393397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:23.393877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:23.394685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:23.395383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:23.395879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:23.396296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:23.524566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:23.533073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-352265cc-e711-4efd-9621-0409015a2f78 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.151689 Aug 08 02:39:23.533644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 333/675] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:23 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:24.553707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:24.554535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:24.561086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:24.561575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:24.562024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:24.562756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:24.563217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:24.563648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:24.698158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:24.707485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e08e483f-3fc8-47f9-a3e4-dcc73255dc76 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.157581 Aug 08 02:39:24.708058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 343/676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:24 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:25.614639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:25.616873 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:25.623639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:25.624110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:25.624539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:25.625251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:25.625700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:25.626116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:25.647921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lazy-loading 'flavor' on Instance uuid 08b62cb1-88d8-45e9-b506-339fedab711a {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:39:25.729818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:25.730486 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:25.737376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:25.737855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:25.738292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:25.739021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:25.739476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:25.739901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:25.867803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:25.875755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3ec2c5d8-d24c-43d2-9a1f-658e0c26d37c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.149810 Aug 08 02:39:25.876309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 344/677] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:25 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:25.981785 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4d565772-2764-49a4-bd84-9b0d278d5110 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/action" status: 200 len: 32 microversion: 2.1 time: 0.371026 Aug 08 02:39:25.986782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 334/678] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:39:25 2022] POST /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/action => generated 32 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:39:25.992365 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:25.992989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:25.998795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:25.999278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:25.999712 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:26.000410 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:26.000866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:26.001290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:26.136452 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:26.145585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f6196c08-7d8e-4537-8dc8-6fad55aefd72 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.157085 Aug 08 02:39:26.146149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 345/679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:25 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:26.898015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:26.898651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:26.905057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:26.905531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:26.905972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:26.906664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:26.907112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:26.907528 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:27.034738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:27.042587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4eaa0aa6-87cd-48db-b34a-c41e8861e35a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.149310 Aug 08 02:39:27.043155 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 335/680] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:26 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:27.165981 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:27.166560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:27.173752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:27.174232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:27.174705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:27.175396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:27.175851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:27.176280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:27.304851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:27.312694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b937f236-8915-4ff1-9ced-e48252d9fed6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.150470 Aug 08 02:39:27.313253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 346/681] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:27 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:28.064448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:28.065058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:28.071451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:28.071935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:28.072372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:28.073061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:28.073522 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:28.073949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:28.209898 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:28.217988 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-310de1ba-aa19-4e17-a20f-bb241797aa2b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.157955 Aug 08 02:39:28.218586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 336/682] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:28 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:28.333805 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:28.334444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:28.340738 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:28.341256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:28.341941 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:28.342592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:28.343048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:28.343476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:28.471621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:28.479648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-02e0219a-53cd-4107-a437-8b85db94b2e3 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.149618 Aug 08 02:39:28.480209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 347/683] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:28 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:29.244773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:29.245372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:29.252155 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:29.252627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:29.253056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:29.253730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:29.254179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:29.254628 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:29.381901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:29.390536 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d9a240ef-cf50-4906-bf5b-b4d4943fb1d1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.149725 Aug 08 02:39:29.391108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 337/684] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:29 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:29.503395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:29.504038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:29.510369 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:29.510861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:29.511301 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:29.512015 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:29.512453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:29.512883 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:29.642836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:29.650687 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-820579d3-a687-4c2a-a2fd-9bab7cfde26e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.151087 Aug 08 02:39:29.651251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 348/685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:29 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:30.410832 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:30.411442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:30.419118 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:30.420507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:30.421222 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:30.422041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:30.422627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:30.423056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:30.571533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:30.580503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-076afe59-70b1-45f1-aea5-67100d721e00 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.173462 Aug 08 02:39:30.581079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 338/686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:30 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:30.671694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:30.672242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:30.678693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:30.679180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:30.679629 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:30.680322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:30.680785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:30.681366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:30.822314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:30.831455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a60da2f7-fa22-47c4-aa08-2283151a69dd tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.163499 Aug 08 02:39:30.831926 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 349/687] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:30 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:31.601840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:31.602476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:31.609748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:31.610220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:31.610672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:31.611356 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:31.611823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:31.612237 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:31.737262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:31.745068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3ea50d8c-1cd3-4799-b581-ef7e4d8ea93b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.147095 Aug 08 02:39:31.745627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 339/688] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:31 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:31.853269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:31.853810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:31.861013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:31.861497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:31.861938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:31.862654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:31.863112 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:31.863538 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:31.993096 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:32.001207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-66823fb7-5ff0-4205-a30b-29e9d22b64eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.151942 Aug 08 02:39:32.001765 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 350/689] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:31 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:32.766539 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:32.767137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:32.773451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:32.773927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:32.774370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:32.775051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:32.775498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:32.775916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:32.904546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:32.912487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3a548221-071a-435f-8135-852caf8be73b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.149833 Aug 08 02:39:32.913092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 340/690] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:32 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:33.022649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:33.023193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:33.029485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:33.029950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:33.030431 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:33.031124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:33.031580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:33.032008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:33.168574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:33.168574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c7c05ad7-ab20-4164-a124-f93b59f5fd53 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.149733 Aug 08 02:39:33.169032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 351/691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:33 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:33.933269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:33.933904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:33.940829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:33.941306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:33.941733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:33.942433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:33.942880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:33.943297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:34.072355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:34.081379 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-48e466de-5947-44c9-b19c-1e709f6affc7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1724 microversion: 2.1 time: 0.151988 Aug 08 02:39:34.081943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 341/692] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:33 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:34.190752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:34.191371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:34.197714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:34.198204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:34.198686 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:34.199382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:34.199842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:34.200271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:34.329759 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:34.337852 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5c2282a7-4655-4e0f-8149-f8ec045fd252 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.150955 Aug 08 02:39:34.338433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 352/693] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:34 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:39:35.102796 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:35.103401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:35.110194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.110700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.111128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.111807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.112254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.112670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.131922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:35.242744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:35.250726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ff61e2b1-5855-44b8-badf-73191eee167b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1701 microversion: 2.1 time: 0.151778 Aug 08 02:39:35.251290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 342/694] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:35 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:35.274145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7de16582-b9fd-4dcd-b248-505a5847075b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:35.281393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de16582-b9fd-4dcd-b248-505a5847075b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.281874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de16582-b9fd-4dcd-b248-505a5847075b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.282311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de16582-b9fd-4dcd-b248-505a5847075b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.285863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:35.303794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7de16582-b9fd-4dcd-b248-505a5847075b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Going to try to start instance {{(pid=124659) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 02:39:35.359274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:35.359806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:35.365586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.366066 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.366540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.367239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.367674 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.368095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.501819 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7de16582-b9fd-4dcd-b248-505a5847075b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action" status: 202 len: 0 microversion: 2.1 time: 0.231388 Aug 08 02:39:35.502556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 353/695] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:39:35 2022] POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:39:35.502906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:35.510952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:35.524673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c6cb348b-7956-4b3a-9e0b-483285f59b45 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.156530 Aug 08 02:39:35.524848 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:35.524954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 343/696] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:35 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:39:35.525058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.525058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.525058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.525058 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:35.525404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:35.525404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:35.655326 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:35.663292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ef9a1992-0be6-4614-b0ae-2befb507a8c3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1710 microversion: 2.1 time: 0.156378 Aug 08 02:39:35.667539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 354/697] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:35 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:39:36.533317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:36.533911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:36.541084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:36.544801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:36.544801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:36.544801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:36.544801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:36.545211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:36.673787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:36.681806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9fcf349d-9263-4e5b-ac10-d9b9426ae2b6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.152618 Aug 08 02:39:36.682519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 344/698] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:36 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:36.684526 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:36.685909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:36.692417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:36.693005 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:36.693442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:36.694128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:36.694603 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:36.695021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:36.822925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:36.830918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ae1e6e54-760b-4a3d-8390-51a96a415877 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1710 microversion: 2.1 time: 0.151010 Aug 08 02:39:36.831480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 355/699] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:36 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:39:37.705096 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:37.705697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:37.712032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:37.712509 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:37.712965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:37.713626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:37.714078 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:37.714529 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:37.843990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:37.852147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:37.852643 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-19439cdd-97c5-426d-b047-b9d9ba2b8066 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.151717 Aug 08 02:39:37.852756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:37.852862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 345/700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:37 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:37.859193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:37.859674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:37.860110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:37.860801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:37.861255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:37.861681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:37.990139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:37.998813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-33ade52a-27dc-4e10-b408-9bcf6c9aa44a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1714 microversion: 2.1 time: 0.150373 Aug 08 02:39:37.999373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 356/701] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:37 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:39:38.873373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:38.873985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:38.881518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:38.882330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:38.883189 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:38.884336 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:38.885023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:38.885453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:39.012672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:39.021516 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4c89ae36-c253-4d02-adcb-717ee2758005 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.152215 Aug 08 02:39:39.022180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 346/702] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:38 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:40.041939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:40.042620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:40.045944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=37 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:40.050750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:40.058006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:40.058006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:40.058006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:40.058006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:40.058514 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:40.389735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:40.397587 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5f91584b-5c41-4e2a-a9fd-0cd769ce9860 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.359467 Aug 08 02:39:40.398201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 357/703] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:40 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:41.419023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:41.419740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:41.426119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:41.426634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:41.427074 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:41.427759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:41.428221 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:41.428644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:41.557134 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:41.565625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e838f35b-486e-4d8f-9249-7d9793218669 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.150532 Aug 08 02:39:41.566193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 347/704] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:41 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:42.587265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:42.587868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:42.595032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:42.595512 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:42.595946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:42.596625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:42.597076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:42.597498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:42.721608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:42.729479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-acfe01c4-1c84-4bfa-983e-9c0edaa37b60 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.146054 Aug 08 02:39:42.730046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 358/705] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:42 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:43.750846 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:43.751485 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:43.757845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:43.758317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:43.758784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:43.759460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:43.759910 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:43.760329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:43.900697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:43.908858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-394f7bb6-e5a4-40e5-bc92-b61645c5e940 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.162484 Aug 08 02:39:43.909439 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 348/706] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:43 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:44.930131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:44.930768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:44.938065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:44.938580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:44.939016 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:44.939736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:44.940178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:44.940592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:45.076425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:45.085484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-20dff5b5-5391-4ee5-a0f9-aeacd154b2d6 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1733 microversion: 2.1 time: 0.159163 Aug 08 02:39:45.086040 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 359/707] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:44 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:46.112272 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:46.112900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:46.114831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=41 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:46.119477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.119952 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.120550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.121243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.121695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.122130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.473564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:46.481581 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3eefeda2-19f3-4ded-a3df-64b30169cfea tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1713 microversion: 2.1 time: 0.374102 Aug 08 02:39:46.482397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 349/708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:46 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1713 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:46.547065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:46.548169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:46.555163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.555640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.556067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.556753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.557199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.557618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.636922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] HTTP exception thrown: Cannot 'detach_volume' instance 08b62cb1-88d8-45e9-b506-339fedab711a while it is in vm_state rescued Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Request method failure captured: Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments/23f48dfd-82f4-43f8-8d50-3d482421dc8d HTTP/1.1 Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW4UlCKJdsfVo1Yrub2DfbsQUnl56LGKCg8UwvCa3txiYym0JrUsoXuW_CnUiVUildOjZo9GLYB4DgWAajQ89ZQUG0v5MQhNaqRYSpF43ngQyWSiPwaFBAzHGoBC_pEJEFhiHmHNIVrkv2ZiwY_DJTB76YyD8PuhUJJDO4vqeoBlT8 Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:39:46.644393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f1f194384993444da5c7b7f30e42746d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f6fb96d9442147e0a2201fe890d6f955 Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:39:46.646107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Cannot 'detach_volume' instance 08b62cb1-88d8-45e9-b506-339fedab711a while it is in vm_state rescued Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'server_id': '08b62cb1-88d8-45e9-b506-339fedab711a', 'id': '23f48dfd-82f4-43f8-8d50-3d482421dc8d'} Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08b62cb1-88d8-45e9-b506-339fedab711a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:39:46.646989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 08b62cb1-88d8-45e9-b506-339fedab711a while it is in vm_state rescued Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 08b62cb1-88d8-45e9-b506-339fedab711a while it is in vm_state rescued Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:39:46.648586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Returning 409 to user: Cannot 'detach_volume' instance 08b62cb1-88d8-45e9-b506-339fedab711a while it is in vm_state rescued {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:39:46.649777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9fff8af1-37c8-486d-b366-c3294f4cf1f4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments/23f48dfd-82f4-43f8-8d50-3d482421dc8d" status: 409 len: 152 microversion: 2.1 time: 0.098023 Aug 08 02:39:46.649777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 360/709] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:39:46 2022] DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments/23f48dfd-82f4-43f8-8d50-3d482421dc8d => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 02:39:46.649951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:46.650224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:46.656495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.656980 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.657412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.658104 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.658597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.659020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.890242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f1c67d44-199d-4cc7-812e-d8c7034b9421 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "POST /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/action" status: 202 len: 0 microversion: 2.1 time: 0.243569 Aug 08 02:39:46.890938 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 350/710] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:39:46 2022] POST /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:39:46.899196 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:46.899801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:46.906387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.906881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.907343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:46.908177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:46.908634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:46.909063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:47.039028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:47.048119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-09257f14-ddc6-4357-b883-8b4db6928a1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1721 microversion: 2.1 time: 0.152701 Aug 08 02:39:47.048914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 361/711] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:46 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:39:48.069303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:48.069993 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:48.076045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:48.076548 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:48.077719 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:48.078448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:48.079170 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:48.079589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:48.210423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:48.218198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-96326d3b-7e42-4cbc-b92d-501d26f25b1c tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1721 microversion: 2.1 time: 0.153523 Aug 08 02:39:48.218878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 351/712] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:48 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:49.245944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:49.246530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:49.253448 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:49.255783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:49.255783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:49.255783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:49.255783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:49.256231 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:49.386643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:49.395076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f4b492b8-f0c3-4536-ae85-47871f2aa1f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1721 microversion: 2.1 time: 0.153315 Aug 08 02:39:49.395625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 362/713] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:49 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:50.416486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:50.417101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:50.423862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:50.424344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:50.424787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:50.425488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:50.426002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:50.426456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:50.560401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:50.570252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3934bd65-5c56-409a-bea0-f8729143bae0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1727 microversion: 2.1 time: 0.157585 Aug 08 02:39:50.570923 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 352/714] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:39:50 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:39:50.590847 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:50.591342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:50.598473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:50.598947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:50.599395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:50.600176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:50.600624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:50.601045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:50.677631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e7483663-21f3-4929-a2dc-0243c433a3f0 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090721 Aug 08 02:39:50.678228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 363/715] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:39:50 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:39:51.664018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-02a8604a-b7f6-4c91-a370-d5867df04f09 req-6ee16de4-af27-4721-ad0f-854eb454d2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b62cb1-88d8-45e9-b506-339fedab711a", "tag": "02e01264-c556-4152-ab45-aa8f19b46808"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:51.673537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-02a8604a-b7f6-4c91-a370-d5867df04f09 req-6ee16de4-af27-4721-ad0f-854eb454d2b0 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:51.674012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-02a8604a-b7f6-4c91-a370-d5867df04f09 req-6ee16de4-af27-4721-ad0f-854eb454d2b0 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:51.674466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-02a8604a-b7f6-4c91-a370-d5867df04f09 req-6ee16de4-af27-4721-ad0f-854eb454d2b0 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:51.685907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-02a8604a-b7f6-4c91-a370-d5867df04f09 req-6ee16de4-af27-4721-ad0f-854eb454d2b0 service nova] Creating event network-changed:02e01264-c556-4152-ab45-aa8f19b46808 for instance 08b62cb1-88d8-45e9-b506-339fedab711a on hv-cinder-85226 Aug 08 02:39:51.691401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-02a8604a-b7f6-4c91-a370-d5867df04f09 req-6ee16de4-af27-4721-ad0f-854eb454d2b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090967 Aug 08 02:39:51.692080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 353/716] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:39:53.707311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-af476dfb-ea8c-485e-af34-c66cbfa1095c req-b7b44458-2a94-4e7c-a0dd-3859b80f0645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b62cb1-88d8-45e9-b506-339fedab711a", "tag": "02e01264-c556-4152-ab45-aa8f19b46808"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:53.716731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-af476dfb-ea8c-485e-af34-c66cbfa1095c req-b7b44458-2a94-4e7c-a0dd-3859b80f0645 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:53.717201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-af476dfb-ea8c-485e-af34-c66cbfa1095c req-b7b44458-2a94-4e7c-a0dd-3859b80f0645 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:53.717630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-af476dfb-ea8c-485e-af34-c66cbfa1095c req-b7b44458-2a94-4e7c-a0dd-3859b80f0645 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:53.728921 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-af476dfb-ea8c-485e-af34-c66cbfa1095c req-b7b44458-2a94-4e7c-a0dd-3859b80f0645 service nova] Creating event network-changed:02e01264-c556-4152-ab45-aa8f19b46808 for instance 08b62cb1-88d8-45e9-b506-339fedab711a on hv-cinder-85226 Aug 08 02:39:53.733837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-af476dfb-ea8c-485e-af34-c66cbfa1095c req-b7b44458-2a94-4e7c-a0dd-3859b80f0645 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031860 Aug 08 02:39:53.734627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 364/717] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:01.081087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:01.081660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:01.087954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:01.092141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:01.092141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:01.092141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:01.092141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:01.092597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:01.119772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4d1cfa8e-0d05-4f82-a815-f03d965febf7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments/4b136508-005b-42e2-a8df-0937c4548ddd" status: 200 len: 194 microversion: 2.20 time: 0.044386 Aug 08 02:40:01.120344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 354/718] 10.222.0.15 () {60 vars in 1454 bytes} [Mon Aug 8 02:40:01 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments/4b136508-005b-42e2-a8df-0937c4548ddd => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:40:01.190257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:01.190798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:01.196883 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:01.199131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:01.199131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:01.199131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:01.199131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:01.199558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:01.278200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lazy-loading 'services' on Instance uuid 406d6f4e-a119-4be3-82c0-61f8de65229a {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:01.663488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-eb1bcc3a-980e-46da-b85d-45c6d27ef78a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments/4b136508-005b-42e2-a8df-0937c4548ddd" status: 202 len: 0 microversion: 2.20 time: 0.477877 Aug 08 02:40:01.667621 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 365/719] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Aug 8 02:40:01 2022] DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments/4b136508-005b-42e2-a8df-0937c4548ddd => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:40:01.672776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:01.675118 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:01.681052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:01.681529 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:01.681954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:01.682676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:01.683119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:01.683532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:01.713571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-970758b0-ad19-4955-815a-6114b35552b6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044744 Aug 08 02:40:01.714136 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 355/720] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 02:40:01 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:40:02.738128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:02.740396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:02.746425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:02.746902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:02.747336 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:02.748024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:02.748471 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:02.748893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:02.776444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dbce8d87-8bbd-4501-b5d2-f7242732d661 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043955 Aug 08 02:40:02.776988 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 366/721] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 02:40:02 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:40:03.676008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1370271872"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:03.676545 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:03.682423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:03.682905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:03.683334 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:03.684016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:03.684467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:03.684888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:03.789263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:03.791474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:03.797809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:03.798284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:03.798746 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:03.800503 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:03.800956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:03.801384 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:03.811400 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.network.security_group_api [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Removing security group 7f7711eb-fcaa-4daa-a144-201e3b1c9867 from port b1663d83-3f81-40a7-968b-47e96bdf8eb3 Aug 08 02:40:03.831443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fb5d942f-002d-49bc-abea-d3ef9d13f286 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046100 Aug 08 02:40:03.831894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 367/722] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 02:40:03 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:03.894982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:03.895475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:03.901545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:03.902117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:03.902588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:03.903320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:03.903774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:03.904202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:03.929559 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:40:03.943805 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:04.166802 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c07d8775-20d2-457a-87d0-3e9470eadf06 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 204 len: 0 microversion: 2.20 time: 0.275257 Aug 08 02:40:04.167418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 368/723] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 02:40:03 2022] DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 02:40:04.176305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:04.177038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:04.182871 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:04.183352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:04.183822 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:04.184516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:04.184978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:04.185409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:04.207937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-768cdfdb-6f4a-4a37-a436-0ac3fb8a44b5 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/action" status: 202 len: 0 microversion: 2.1 time: 0.633763 Aug 08 02:40:04.214924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 356/724] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:40:03 2022] POST /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:40:04.220306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-69b2c407-87fc-496f-a6a9-4727e01e9027 req-3e9290c1-fde9-4866-88eb-bb1903637f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:04.231947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-69b2c407-87fc-496f-a6a9-4727e01e9027 req-3e9290c1-fde9-4866-88eb-bb1903637f4c service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:04.237375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-69b2c407-87fc-496f-a6a9-4727e01e9027 req-3e9290c1-fde9-4866-88eb-bb1903637f4c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:04.237375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-69b2c407-87fc-496f-a6a9-4727e01e9027 req-3e9290c1-fde9-4866-88eb-bb1903637f4c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:04.247921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-69b2c407-87fc-496f-a6a9-4727e01e9027 req-3e9290c1-fde9-4866-88eb-bb1903637f4c service nova] Creating event network-changed:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:40:04.259594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-69b2c407-87fc-496f-a6a9-4727e01e9027 req-3e9290c1-fde9-4866-88eb-bb1903637f4c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043109 Aug 08 02:40:04.260672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 357/725] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:04.402864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:04.412644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:04.415259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:04.416571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c1269a27-aa85-4c53-85c4-0e261ad77a43 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.244855 Aug 08 02:40:04.417242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 369/726] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:04 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:40:05.441911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:05.442706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:05.446108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:05.446714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:05.450550 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:05.451109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:05.451814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:05.452591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:05.454322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:05.454681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:05.454903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:05.455164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:05.455791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:05.456495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:05.456972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:05.457375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:05.459841 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:05.549965 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lazy-loading 'services' on Instance uuid 2013baeb-7052-438d-80c7-7e2be6eddca9 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:05.631781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:05.639702 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:05.641858 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:05.642646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-74aa5178-2b01-459e-aa0d-006a72c826ac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.206548 Aug 08 02:40:05.643440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 358/727] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:05 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:05.767740 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d241f057-15a8-4a2f-aaa9-1cb308dd076c tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments/1cb8c9af-e316-4ccd-a7f8-e0859dc6131b" status: 202 len: 0 microversion: 2.1 time: 0.325201 Aug 08 02:40:05.768329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 370/728] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:40:05 2022] DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments/1cb8c9af-e316-4ccd-a7f8-e0859dc6131b => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:40:05.776592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:05.778825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:05.785774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:05.788899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:05.788899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:05.788899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:05.788899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:05.789284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:05.819318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-27a525fd-939d-4c58-a81b-bd292ff6033b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Aug 08 02:40:05.819801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 359/729] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:40:05 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:06.277503 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-08c742bf-c5b4-4372-92f7-1c29fca70cf1 req-bfd4380d-6cf1-4abc-b412-9f0119c9682e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:06.288335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-08c742bf-c5b4-4372-92f7-1c29fca70cf1 req-bfd4380d-6cf1-4abc-b412-9f0119c9682e service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:06.288819 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-08c742bf-c5b4-4372-92f7-1c29fca70cf1 req-bfd4380d-6cf1-4abc-b412-9f0119c9682e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:06.289227 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-08c742bf-c5b4-4372-92f7-1c29fca70cf1 req-bfd4380d-6cf1-4abc-b412-9f0119c9682e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:06.300671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-08c742bf-c5b4-4372-92f7-1c29fca70cf1 req-bfd4380d-6cf1-4abc-b412-9f0119c9682e service nova] Creating event network-changed:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:40:06.305477 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-08c742bf-c5b4-4372-92f7-1c29fca70cf1 req-bfd4380d-6cf1-4abc-b412-9f0119c9682e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033489 Aug 08 02:40:06.306067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 371/730] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:06.666888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:06.667497 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:06.673806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:06.674728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:06.674917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:06.675636 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:06.676359 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:06.676494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:06.833402 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:06.835804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:06.842157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:06.842699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:06.843136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:06.843852 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:06.844293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:06.844716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:06.876066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c5c9fcaf-77ab-4cde-b7d7-43de51f4fc62 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047939 Aug 08 02:40:06.876650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 372/731] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:40:06 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:40:07.272103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:07.280067 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:07.281571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:07.282758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8a544857-0898-4e6e-b05f-39c0c541d729 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1725 microversion: 2.20 time: 0.619860 Aug 08 02:40:07.283861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 360/732] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:06 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1725 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:07.889229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:07.892035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:07.899065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:07.899535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:07.899964 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:07.900648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:07.901097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:07.901515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:07.931543 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-584f32be-e4d0-43d4-9db5-edd4ec629538 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046145 Aug 08 02:40:07.932117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 373/733] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:40:07 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:40:07.943192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:07.943729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:07.950146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:07.950685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:07.954542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:07.954542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:07.954542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:07.954542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:08.029526 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] HTTP exception thrown: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 is not attached to volume 1cb8c9af-e316-4ccd-a7f8-e0859dc6131b Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Request method failure captured: Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments/1cb8c9af-e316-4ccd-a7f8-e0859dc6131b HTTP/1.1 Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HYeBii4R51uVK_l9FIlTeXZ1T4nYNj-j1vQi_pLUzSlh5VJWdu6ccnWa58yUPfSHN1HB0871Jjs9wCfPd9iwjSjHkjuWOYKzqvKe6ezUfThkNqmHdc5l1BBZTP9T98C9sri2OgXjz3fGmj38D57UMVYAT-PnCTv9qJZ7WMWxVxnYfQ Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 31bdca178d874d499b1492305ad45a9c Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-TestMinimumBasicScenario-781954605 Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:40:08.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_31bdca178d874d499b1492305ad45a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/31bdca178d874d499b1492305ad45a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/31bdca178d874d499b1492305ad45a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/31bdca178d874d499b1492305ad45a9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-TestMinimumBasicScenario-781954605 Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 31bdca178d874d499b1492305ad45a9c Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-TestMinimumBasicScenario-781954605 Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-TestMinimumBasicScenario-781954605-project Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 747b60cf32a14b93bee399fce7a9b54b Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-TestMinimumBasicScenario-781954605-project Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:40:08.033740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 is not attached to volume 1cb8c9af-e316-4ccd-a7f8-e0859dc6131b Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'server_id': '2013baeb-7052-438d-80c7-7e2be6eddca9', 'id': '1cb8c9af-e316-4ccd-a7f8-e0859dc6131b'} Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1cb8c9af-e316-4ccd-a7f8-e0859dc6131b. Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:40:08.034944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 is not attached to volume 1cb8c9af-e316-4ccd-a7f8-e0859dc6131b Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 is not attached to volume 1cb8c9af-e316-4ccd-a7f8-e0859dc6131b Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:08.036258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Returning 404 to user: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 is not attached to volume 1cb8c9af-e316-4ccd-a7f8-e0859dc6131b {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:40:08.037255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-97ee9a88-1a5a-44b2-81f7-ba6c1042d6cf tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments/1cb8c9af-e316-4ccd-a7f8-e0859dc6131b" status: 404 len: 154 microversion: 2.1 time: 0.094988 Aug 08 02:40:08.037255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 361/734] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:40:07 2022] DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9/os-volume_attachments/1cb8c9af-e316-4ccd-a7f8-e0859dc6131b => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:40:08.307619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:08.308223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:08.314032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:08.314604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:08.315585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:08.318494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:08.318494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:08.318494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:08.385446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-3d112fc7-95b8-4aaa-9d68-17bcd05bd8c1 req-3f7bf78d-557e-467e-a405-a10acac51164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d6f4e-a119-4be3-82c0-61f8de65229a", "name": "network-vif-deleted", "tag": "438a8af0-9043-4725-b741-8f21cc9f8097"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:08.395983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3d112fc7-95b8-4aaa-9d68-17bcd05bd8c1 req-3f7bf78d-557e-467e-a405-a10acac51164 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:08.396525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3d112fc7-95b8-4aaa-9d68-17bcd05bd8c1 req-3f7bf78d-557e-467e-a405-a10acac51164 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:08.396965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-3d112fc7-95b8-4aaa-9d68-17bcd05bd8c1 req-3f7bf78d-557e-467e-a405-a10acac51164 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:08.400931 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:08.409380 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-3d112fc7-95b8-4aaa-9d68-17bcd05bd8c1 req-3f7bf78d-557e-467e-a405-a10acac51164 service nova] Creating event network-vif-deleted:438a8af0-9043-4725-b741-8f21cc9f8097 for instance 406d6f4e-a119-4be3-82c0-61f8de65229a on hv-cinder-85226 Aug 08 02:40:08.413329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:08.417409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:08.417542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-3d112fc7-95b8-4aaa-9d68-17bcd05bd8c1 req-3f7bf78d-557e-467e-a405-a10acac51164 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Aug 08 02:40:08.417636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8f4e20df-6696-4afe-b9ec-3d35d90fdc09 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 200 len: 1657 microversion: 2.20 time: 0.112894 Aug 08 02:40:08.417636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 374/735] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:08 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 1657 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:08.419492 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 362/736] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:40:09.338683 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:09.339775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:09.346798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:09.349439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:09.349439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:09.349439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:09.350193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:09.350753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:09.376181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:40:09.441599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:09.442292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:09.449375 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:09.450244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:09.450931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:09.451864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:09.452517 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:09.453157 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:09.468464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] HTTP exception thrown: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Request method failure captured: Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a HTTP/1.1 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW130sMqltG59_Bk4ZAu1m5FL58nAPZCfaVZwE9GJY_VQiCD8H9H6MR82CalBegP5Suk820exj3LlqVBa8fLepKmuJaL_GYtU522PwqElRK_tIx2Hl8dC10tVj7iLU47rCG5NVFARulcTNTzmyxfpnD865gKCZTPVR2d6I66-8HV2E Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:40:09.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 7fd9eb21aa634650a7022b7b4ca145fd Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:40:09.472073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '406d6f4e-a119-4be3-82c0-61f8de65229a'} Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:40:09.472885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:40:09.474416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:09.475696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Returning 404 to user: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:40:09.475696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-996592bb-f905-492b-b89e-2b49f7a076cb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 404 len: 111 microversion: 2.20 time: 0.035481 Aug 08 02:40:09.476112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 363/737] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:09 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 02:40:09.480775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-37fe87f7-4c94-482a-94d5-750cb39626de tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '.version_select at 0x7fb2ba076dc0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:09.574971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-37fe87f7-4c94-482a-94d5-750cb39626de tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000284397" status: 204 len: 0 microversion: 2.20 time: 0.097720 Aug 08 02:40:09.575552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 364/738] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Aug 8 02:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000284397 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 02:40:09.671657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4d873466-ec2a-474a-9017-3b83b31ff497 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 204 len: 0 microversion: 2.1 time: 0.336311 Aug 08 02:40:09.673332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 375/739] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:40:09 2022] DELETE /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:40:09.681580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:09.682712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:09.690436 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:09.691403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:09.691904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:09.692959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:09.693604 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:09.694032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:09.845143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:09.854265 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-99babf59-d590-4f89-8b26-e61d3053ee2b tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1552 microversion: 2.1 time: 0.176668 Aug 08 02:40:09.855149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 365/740] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:09 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:10.382710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fe8001ab-3c7e-4999-83f4-80580a665482 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'create', calling method: .version_select at 0x7fb2bead8e50>, body: {"keypair": {"name": "tempest-keypair-38010807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBBrKh2jZZ6AarQUmo+gaP74r/Ayq+XZcsmMw7dfVjWw68pzW0p8WU99FU0IW+zVriwbCLfMlZ8Rc2/7wDu77hfJUqPgcGNLDOvQT7BcmOy3hdmCdREJ+kmPedz1qkvAA=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:10.388593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:10.399748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-fe8001ab-3c7e-4999-83f4-80580a665482 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:40:10.404446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-fe8001ab-3c7e-4999-83f4-80580a665482 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for user 7fd9eb21aa634650a7022b7b4ca145fd and project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:40:10.504904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fe8001ab-3c7e-4999-83f4-80580a665482 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.126473 Aug 08 02:40:10.510671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 376/741] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Aug 8 02:40:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 02:40:10.875407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:10.876203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:10.883622 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:10.884112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:10.884546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:10.885250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:10.885706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:10.886179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:11.159753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:11.167324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-51ae9502-ebfd-4d11-9b8c-bf1d4dd91b9a tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1552 microversion: 2.1 time: 0.295964 Aug 08 02:40:11.167894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 366/742] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:10 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1552 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:11.603003 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-8a0db81f-94e8-4871-9e13-995c644bcd1e req-2028cdf5-3432-40af-82ea-886d25651a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013baeb-7052-438d-80c7-7e2be6eddca9", "name": "network-vif-deleted", "tag": "b1663d83-3f81-40a7-968b-47e96bdf8eb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:11.612179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8a0db81f-94e8-4871-9e13-995c644bcd1e req-2028cdf5-3432-40af-82ea-886d25651a81 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:11.612659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8a0db81f-94e8-4871-9e13-995c644bcd1e req-2028cdf5-3432-40af-82ea-886d25651a81 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:11.613097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8a0db81f-94e8-4871-9e13-995c644bcd1e req-2028cdf5-3432-40af-82ea-886d25651a81 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:11.623934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-8a0db81f-94e8-4871-9e13-995c644bcd1e req-2028cdf5-3432-40af-82ea-886d25651a81 service nova] Creating event network-vif-deleted:b1663d83-3f81-40a7-968b-47e96bdf8eb3 for instance 2013baeb-7052-438d-80c7-7e2be6eddca9 on hv-cinder-85226 Aug 08 02:40:11.629695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-8a0db81f-94e8-4871-9e13-995c644bcd1e req-2028cdf5-3432-40af-82ea-886d25651a81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031031 Aug 08 02:40:11.630401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 377/743] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:12.188660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:12.189365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:12.196284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:12.196759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:12.197316 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:12.197857 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:12.198376 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:12.198886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:12.235007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:12.235403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:12.235834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:12.236506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lazy-loading 'fault' on Instance uuid 2013baeb-7052-438d-80c7-7e2be6eddca9 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:12.278387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '747b60cf32a14b93bee399fce7a9b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bdca178d874d499b1492305ad45a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:12.286986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-411d26e4-c59d-45bb-bc58-ebf9ba92c058 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 200 len: 1347 microversion: 2.1 time: 0.101989 Aug 08 02:40:12.287807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 367/744] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:12 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:12.907309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-283426860", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87360f95-f3ba-477f-b837-ec26e9e98a48"}], "security_groups": [{"name": "tempest-securitygroup--1480963965"}], "key_name": "tempest-keypair-38010807", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:13.011776 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] validate_networks() for [('87360f95-f3ba-477f-b837-ec26e9e98a48', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:40:13.308697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:13.309302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] [instance: 2013baeb-7052-438d-80c7-7e2be6eddca9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:13.316006 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:13.316483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:13.316912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:13.317598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:13.318052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:13.318502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:13.332340 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] HTTP exception thrown: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 could not be found. Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Request method failure captured: Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 HTTP/1.1 Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HYeBii4R51uVK_l9FIlTeXZ1T4nYNj-j1vQi_pLUzSlh5VJWdu6ccnWa58yUPfSHN1HB0871Jjs9wCfPd9iwjSjHkjuWOYKzqvKe6ezUfThkNqmHdc5l1BBZTP9T98C9sri2OgXjz3fGmj38D57UMVYAT-PnCTv9qJZ7WMWxVxnYfQ Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 31bdca178d874d499b1492305ad45a9c Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-TestMinimumBasicScenario-781954605 Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:40:13.333891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_31bdca178d874d499b1492305ad45a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/31bdca178d874d499b1492305ad45a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/31bdca178d874d499b1492305ad45a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/31bdca178d874d499b1492305ad45a9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-TestMinimumBasicScenario-781954605 Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 31bdca178d874d499b1492305ad45a9c Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-TestMinimumBasicScenario-781954605 Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-TestMinimumBasicScenario-781954605-project Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 747b60cf32a14b93bee399fce7a9b54b Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-TestMinimumBasicScenario-781954605-project Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 could not be found. Aug 08 02:40:13.335493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '2013baeb-7052-438d-80c7-7e2be6eddca9'} Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 could not be found. Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:40:13.336306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 could not be found. Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 could not be found. Aug 08 02:40:13.337473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:40:13.338592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Returning 404 to user: Instance 2013baeb-7052-438d-80c7-7e2be6eddca9 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:40:13.338592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fb6ff4c8-574e-44b1-8add-20c53d0ff8d0 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9" status: 404 len: 111 microversion: 2.1 time: 0.030449 Aug 08 02:40:13.338592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 368/745] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:13 2022] GET /compute/v2.1/servers/2013baeb-7052-438d-80c7-7e2be6eddca9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:40:13.343680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5ec2d9ca-6600-4293-9622-9050c4d8de45 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] Calling method '.version_select at 0x7fb2ba04b9d0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:13.376548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:40:13.380030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:40:13.380030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:40:13.380030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:40:13.380030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:40:13.386960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:13.387442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:13.387880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:13.388638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:13.389090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:13.389517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:13.405849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:40:13.410308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Getting quotas for user 7fd9eb21aa634650a7022b7b4ca145fd and project dddb64c31c0a4db2a184543c435c7bc0. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:40:13.421229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:40:13.423607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:40:13.430381 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5ec2d9ca-6600-4293-9622-9050c4d8de45 tempest-TestMinimumBasicScenario-781954605 tempest-TestMinimumBasicScenario-781954605-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1610229995" status: 202 len: 0 microversion: 2.1 time: 0.090275 Aug 08 02:40:13.430998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 369/746] 10.222.0.15 () {58 vars in 1272 bytes} [Mon Aug 8 02:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1610229995 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:40:13.551633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fc0bbb05-3fd8-46a3-b89e-74633f5c43a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.649339 Aug 08 02:40:13.552332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 378/747] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Aug 8 02:40:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 02:40:13.563114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94006a66-6ed8-4b23-9e96-bb03bf139a75 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:13.569662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94006a66-6ed8-4b23-9e96-bb03bf139a75 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:13.622186 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94006a66-6ed8-4b23-9e96-bb03bf139a75 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:13.630148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94006a66-6ed8-4b23-9e96-bb03bf139a75 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:13.631641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94006a66-6ed8-4b23-9e96-bb03bf139a75 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:13.632727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94006a66-6ed8-4b23-9e96-bb03bf139a75 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1279 microversion: 2.20 time: 0.073574 Aug 08 02:40:13.633815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 370/748] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:13 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1279 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:14.655810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:14.656369 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:14.663490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:14.664029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:14.664473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:14.665197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:14.665654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:14.666085 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:14.730152 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:14.738519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:14.740078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:14.741183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5d149e00-3147-4be0-ad16-1fdf75ab7139 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1275 microversion: 2.20 time: 0.089576 Aug 08 02:40:14.741743 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 379/749] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:14 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:15.764010 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:15.764853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:15.771610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:15.772612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:15.772612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:15.773293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:15.773745 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:15.774162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:15.876684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:15.886292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:15.888575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:15.889806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5a67e44a-4554-4875-b1de-454f51e50a02 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1337 microversion: 2.20 time: 0.129737 Aug 08 02:40:15.890454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 371/750] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:15 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1337 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:16.914083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:16.915559 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:16.927893 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:16.928588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:16.929193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:16.930110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:16.931217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:16.931843 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:17.153368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:17.163546 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:17.165087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:17.166248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aeb4823e-8d91-4d2a-80e8-05bd407e0eb4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.256331 Aug 08 02:40:17.174536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 380/751] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:16 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:40:17.444304 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-44e08243-a765-4eec-b3ef-acaf50b9aa14 req-b8851175-cdb3-47cc-a762-5b162739d641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:17.451574 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:17.457384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-44e08243-a765-4eec-b3ef-acaf50b9aa14 req-b8851175-cdb3-47cc-a762-5b162739d641 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:17.457999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-44e08243-a765-4eec-b3ef-acaf50b9aa14 req-b8851175-cdb3-47cc-a762-5b162739d641 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:17.459217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-44e08243-a765-4eec-b3ef-acaf50b9aa14 req-b8851175-cdb3-47cc-a762-5b162739d641 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:17.473228 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-44e08243-a765-4eec-b3ef-acaf50b9aa14 req-b8851175-cdb3-47cc-a762-5b162739d641 service nova] Creating event network-changed:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:40:17.480195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-44e08243-a765-4eec-b3ef-acaf50b9aa14 req-b8851175-cdb3-47cc-a762-5b162739d641 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038526 Aug 08 02:40:17.481476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 372/752] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:18.189489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:18.190784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:18.197457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:18.197965 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:18.198518 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:18.199320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:18.199998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:18.200429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:18.348303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:18.356437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:18.358150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:18.359286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-661103ca-8f45-4cf5-813f-2433584423bd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.174137 Aug 08 02:40:18.359841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 381/753] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:18 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:19.382165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:19.382885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:19.389928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:19.390424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:19.390857 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:19.391540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:19.391997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:19.393126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:19.527435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:19.536051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:19.537557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:19.538685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-30fcc094-2da4-4e9d-8909-05a3661a1a8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.160915 Aug 08 02:40:19.539248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 373/754] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:19 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:20.561319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:20.561991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:20.568929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:20.569420 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:20.569856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:20.570582 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:20.571038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:20.571464 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:20.784357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:20.792530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:20.794030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:20.795175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7d9b0271-5aee-433d-85c0-630e0afd774d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.237827 Aug 08 02:40:20.795782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 382/755] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:20 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:21.817441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:21.818046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:21.826447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:21.827023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:21.827587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:21.828365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:21.829138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:21.830783 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:21.973766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:21.981734 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:21.983308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:21.984404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ade0429e-7a0b-46ab-8cce-bd3ba1daa14f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.171239 Aug 08 02:40:21.984964 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 374/756] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:21 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:23.007334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:23.007952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:23.015106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:23.015617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:23.016039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:23.016737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:23.017946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:23.018399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:23.153441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:23.162121 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:23.163732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:23.164862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f3fefba-4594-4810-9f4a-97dfec48ddac tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.161542 Aug 08 02:40:23.165428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 383/757] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:23 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:23.381377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-e112321e-765b-4986-b4e7-6cfc9e065db7 req-970c5b6a-5466-40a9-8a78-4017eafa278f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "name": "network-vif-plugged", "status": "completed", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:23.392862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e112321e-765b-4986-b4e7-6cfc9e065db7 req-970c5b6a-5466-40a9-8a78-4017eafa278f service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:23.393536 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e112321e-765b-4986-b4e7-6cfc9e065db7 req-970c5b6a-5466-40a9-8a78-4017eafa278f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:23.393961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e112321e-765b-4986-b4e7-6cfc9e065db7 req-970c5b6a-5466-40a9-8a78-4017eafa278f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:23.404411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-e112321e-765b-4986-b4e7-6cfc9e065db7 req-970c5b6a-5466-40a9-8a78-4017eafa278f service nova] Creating event network-vif-plugged:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:40:23.409353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-e112321e-765b-4986-b4e7-6cfc9e065db7 req-970c5b6a-5466-40a9-8a78-4017eafa278f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 Aug 08 02:40:23.409968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 375/758] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:24.188299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:24.188915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:24.191035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:24.192134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=10 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:24.197181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:24.197753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:24.198202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:24.199059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:24.199517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:24.199995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:24.338110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:24.341575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:24.348668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:24.350175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:24.351335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-13331340-56e5-4bf7-a3a0-0165cdf8574e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.167021 Aug 08 02:40:24.351903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 384/759] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:24 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:25.371922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:25.376517 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:25.377412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:25.383656 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:25.384138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:25.384564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:25.385250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:25.385699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:25.386120 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:25.521463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:25.529554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:25.531087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:25.532219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-97cfe128-fc52-4858-9209-eca1e8d8ce14 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1405 microversion: 2.20 time: 0.161240 Aug 08 02:40:25.533393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 376/760] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:25 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:40:26.556635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:26.557255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:26.565484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:26.566059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:26.566547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:26.567253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:26.567752 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:26.568187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:26.696884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:26.704998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:26.706738 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:26.707885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aaa89ba9-bd10-4e17-a8c6-1ab8b1007e24 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1597 microversion: 2.20 time: 0.156068 Aug 08 02:40:26.710128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 385/761] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:26 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:26.730143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:26.730683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:26.737799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:26.741864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:26.741864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:26.741864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:26.741864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:26.742210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:26.818742 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-411a966f-3ace-411d-a6e8-be926402011f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092363 Aug 08 02:40:26.819338 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 377/762] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Aug 8 02:40:26 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:40:27.784943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-7f21115a-c735-4e76-b257-feb880134e14 req-f69ebbf6-0a47-4b5d-9d63-161b8dda7040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:27.795119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7f21115a-c735-4e76-b257-feb880134e14 req-f69ebbf6-0a47-4b5d-9d63-161b8dda7040 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:27.795119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7f21115a-c735-4e76-b257-feb880134e14 req-f69ebbf6-0a47-4b5d-9d63-161b8dda7040 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:27.795544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7f21115a-c735-4e76-b257-feb880134e14 req-f69ebbf6-0a47-4b5d-9d63-161b8dda7040 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:27.807552 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-7f21115a-c735-4e76-b257-feb880134e14 req-f69ebbf6-0a47-4b5d-9d63-161b8dda7040 service nova] Creating event network-changed:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:40:27.812101 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-7f21115a-c735-4e76-b257-feb880134e14 req-f69ebbf6-0a47-4b5d-9d63-161b8dda7040 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030921 Aug 08 02:40:27.812698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 386/763] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:28.257569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:28.258118 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:28.285239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:28.286206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:28.286677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:28.287386 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:28.287838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:28.288264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:28.313032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'flavor' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:28.571223 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-01105fcb-62d9-4ed2-abf7-690ce21d6864 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "POST /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83/action" status: 202 len: 0 microversion: 2.1 time: 0.317707 Aug 08 02:40:28.571872 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 378/764] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:40:28 2022] POST /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:40:28.581884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:28.582425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:28.588903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:28.589388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:28.590270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:28.590566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:28.591023 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:28.591651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:28.739759 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:28.747576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c37098ef-947d-4361-a549-8808a1b1b08a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.171050 Aug 08 02:40:28.748146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 387/765] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:28 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:29.771137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:29.771754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:29.777832 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:29.778315 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:29.778792 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:29.779479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:29.779950 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:29.780370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:29.785020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:30.000875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:30.009080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1cac3f18-9847-40d9-b801-0693c1649db5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.243681 Aug 08 02:40:30.009655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 379/766] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:29 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:31.030109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:31.030713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:31.037940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:31.038453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:31.038890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:31.039571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:31.040022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:31.040442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:31.169122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:31.176803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7a884c8f-f105-4841-ba2b-c8bc3709c23d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.150598 Aug 08 02:40:31.177368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 388/767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:31 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:32.199151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:32.199689 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:32.206581 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:32.207055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:32.207483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:32.208151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:32.208596 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:32.209013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:32.353419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:32.361283 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d7240d60-f7b9-4afc-bbbd-b6ea6339d2ce tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.166208 Aug 08 02:40:32.361845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 380/768] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:32 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:33.382977 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:33.383618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:33.389987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:33.390502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:33.390943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:33.391625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:33.392078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:33.393076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:33.522409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:33.529969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b69add32-5e92-4927-811b-d453954358bc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.150904 Aug 08 02:40:33.530554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 389/769] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:33 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:34.551041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:34.551654 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:34.558006 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:34.558526 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:34.558963 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:34.559650 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:34.560106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:34.560530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:34.693147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:34.700697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c03d867c-3786-44dd-9d0c-e45ea4b3f51f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.153734 Aug 08 02:40:34.701267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 381/770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:34 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:35.723083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:35.723739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:35.730030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:35.730547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:35.730984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:35.731670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:35.732127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:35.732550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:35.875545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:35.883011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c6b6b789-1099-4e88-a877-2e6f19907c1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.164486 Aug 08 02:40:35.883589 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 390/771] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:35 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:36.904088 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:36.904694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:36.911804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:36.912305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:36.912773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:36.913475 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:36.913956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:36.914406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:37.043765 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:37.051747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d5bc77f2-be8e-4dcf-bda5-b44d0c700fde tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.151580 Aug 08 02:40:37.052313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 382/772] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:36 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:38.073149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:38.073761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:38.080322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:38.080806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:38.081248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:38.081941 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:38.082418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:38.082851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:38.211922 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:38.219335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a9a14804-56af-4f92-930c-7fd314396254 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.150026 Aug 08 02:40:38.219905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 391/773] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:38 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:39.241537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:39.242137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:39.248469 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:39.248942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:39.249369 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:39.250043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:39.250521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:39.250968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:39.459997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:39.467448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e91f9453-adce-40f1-b025-f1bd052e4e18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.229759 Aug 08 02:40:39.468013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 383/774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:39 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:40.488846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:40.489441 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:40.491857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:40.496528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:40.500884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:40.500884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:40.500884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:40.500884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:40.501290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:40.632090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:40.639465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-52c50d14-ca40-44d5-b0b8-e272eba41c31 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.155063 Aug 08 02:40:40.640027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 392/775] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:40 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:41.661935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:41.662576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:41.669206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:41.669687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:41.670119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:41.670830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:41.671280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:41.671700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:41.807311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:41.815384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2e25a7e8-e3b0-4c26-b8c6-e57919b4b659 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.158081 Aug 08 02:40:41.815961 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 384/776] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:41 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:42.836593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:42.837201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:42.843689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:42.844165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:42.844592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:42.845310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:42.845935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:42.846881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:42.977257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:42.984650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b150f043-6186-4b59-98d3-6d74ac97dba4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1568 microversion: 2.1 time: 0.151921 Aug 08 02:40:42.985207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 393/777] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:42 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:43.005390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:43.005986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:43.012491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:43.012971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:43.013407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:43.014100 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:43.014663 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:43.015096 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:43.176266 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124658) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 02:40:43.432722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6293bcbf-657e-4b43-b21c-78ba57bb0cac tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "POST /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83/action" status: 202 len: 0 microversion: 2.1 time: 0.431682 Aug 08 02:40:43.433254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 385/778] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:40:42 2022] POST /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:40:43.441624 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:43.442238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:43.448288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:43.448768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:43.449209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:43.449904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:43.450372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:43.450820 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:43.585937 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:43.593550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-489797d7-b6e5-4a9c-8451-4f4769ccc43d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1516 microversion: 2.1 time: 0.156026 Aug 08 02:40:43.594112 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 394/779] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:43 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:44.615944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:44.616665 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:44.622712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:44.623254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:44.623756 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:44.624431 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:44.624873 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:44.625292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:44.758803 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:44.766419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-31302504-64b1-457a-a817-cfb8916b102d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1516 microversion: 2.1 time: 0.155391 Aug 08 02:40:44.769051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 386/780] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:44 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:45.259404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-ae98665b-1fde-49e9-9a20-99be447c8beb req-c4944040-fcaa-4401-a00b-68487c5c6af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "name": "network-vif-unplugged", "status": "completed", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:45.271142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-ae98665b-1fde-49e9-9a20-99be447c8beb req-c4944040-fcaa-4401-a00b-68487c5c6af7 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.272628 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-ae98665b-1fde-49e9-9a20-99be447c8beb req-c4944040-fcaa-4401-a00b-68487c5c6af7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.272628 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-ae98665b-1fde-49e9-9a20-99be447c8beb req-c4944040-fcaa-4401-a00b-68487c5c6af7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:45.283080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.compute.server_external_events [req-ae98665b-1fde-49e9-9a20-99be447c8beb req-c4944040-fcaa-4401-a00b-68487c5c6af7 service nova] Unable to find a host for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83. Dropping event network-vif-unplugged {{(pid=124658) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 02:40:45.284567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-ae98665b-1fde-49e9-9a20-99be447c8beb req-c4944040-fcaa-4401-a00b-68487c5c6af7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028972 Aug 08 02:40:45.285151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 387/781] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 08 02:40:45.310745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:45.311229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:45.317406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.317885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.318321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:45.319053 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.319560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.319979 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:45.401492 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lazy-loading 'services' on Instance uuid 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:45.593861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8cb2e36e-6dd6-4aba-bcbc-2e113e568074 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-volume_attachments/92706c9e-845d-4fc1-8a81-2e5e6937aab0" status: 202 len: 0 microversion: 2.1 time: 0.481928 Aug 08 02:40:45.594467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 395/782] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:40:45 2022] DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-volume_attachments/92706c9e-845d-4fc1-8a81-2e5e6937aab0 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:40:45.787976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:45.788585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:45.794669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.795152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.795584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:45.796323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.796788 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.797210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:45.933474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:45.941040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-297fc917-7977-4cfd-b6cf-878525d71b18 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1516 microversion: 2.1 time: 0.156903 Aug 08 02:40:45.942171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 388/783] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:45 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:46.712252 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5ca493dd-0afa-4df0-a300-9493370761c5 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:46.718319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ca493dd-0afa-4df0-a300-9493370761c5 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:46.718829 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ca493dd-0afa-4df0-a300-9493370761c5 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:46.719256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ca493dd-0afa-4df0-a300-9493370761c5 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:46.740861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5ca493dd-0afa-4df0-a300-9493370761c5 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Going to try to stop instance {{(pid=124659) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 02:40:46.913935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5ca493dd-0afa-4df0-a300-9493370761c5 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action" status: 202 len: 0 microversion: 2.1 time: 0.206478 Aug 08 02:40:46.914747 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 396/784] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:40:46 2022] POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:40:46.928731 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:46.929341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:46.936461 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:46.936939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:46.937379 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:46.941945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:46.941945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:46.941945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:47.079129 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:47.080307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:47.081014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:47.087448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e555e72e-e35e-4dcc-9b03-38fc6691c8b2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.162595 Aug 08 02:40:47.088008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 389/785] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:46 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:47.088283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:47.088790 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:47.089223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:47.089918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:47.090393 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:47.090912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:47.225520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:47.233042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c14127f1-0781-4cfc-b4b4-5caf28561a74 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1516 microversion: 2.1 time: 0.274001 Aug 08 02:40:47.233603 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 397/786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:46 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:48.108653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:48.109279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:48.115923 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:48.116403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:48.116833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:48.117513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:48.117966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:48.118410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:48.248391 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:48.254183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:48.254960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:48.256679 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0e59392c-a75a-4cf3-879b-fa4a54277812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.151819 Aug 08 02:40:48.257234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 390/787] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:48 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:48.261693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:48.262160 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:48.262617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:48.263315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:48.263769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:48.279329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:48.397169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:48.404798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3856ad5c-5e21-4b4d-be53-dc1ed5c79048 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1516 microversion: 2.1 time: 0.154673 Aug 08 02:40:48.405428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 398/788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:48 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:49.278603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:49.279216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:49.286144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:49.286662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:49.287122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:49.287816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:49.288272 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:49.288699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:49.425232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:49.426599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:49.432901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:49.433394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:49.433832 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:49.434562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:49.435020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:49.435461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:49.438178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:49.447147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f233c0fb-435d-4dbf-9801-25b0d4bbd812 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.172380 Aug 08 02:40:49.453767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 391/789] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:49 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:49.572007 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:49.579773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bf04b9a1-2e11-42f2-9fdd-8c39d9004aef tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1518 microversion: 2.1 time: 0.158381 Aug 08 02:40:49.580348 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 399/790] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:49 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:50.468847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:50.469451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:50.471895 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:50.477296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:50.477774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:50.478200 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:50.478908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:50.479357 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:50.479769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:50.601119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:50.601959 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:50.609339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:50.609900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:50.610337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:50.611062 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:50.611652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:50.612086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:50.631211 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:50.710760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:50.718768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-29b69daf-ae30-44ec-9994-d34bfb2359dc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.253621 Aug 08 02:40:50.719339 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 392/791] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:50 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:50.750557 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:50.758923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-de6d8ceb-7054-4cd1-975f-7f6cfa45a63f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.161721 Aug 08 02:40:50.759493 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 400/792] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:50 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:51.739810 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:51.740413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:51.746774 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:51.747248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:51.747694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:51.748353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:51.748800 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:51.749214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:51.780638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:51.781284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:51.788384 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:51.788873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:51.789312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:51.790008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:51.790505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:51.790936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:51.885424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:51.893122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3c57766f-87d3-4eed-938b-a62ae1c29e5f tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.157072 Aug 08 02:40:51.893696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 393/793] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:51 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:51.930727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:51.938199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08a48da9-b4c0-4419-b2a9-ef5e9697b305 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.161340 Aug 08 02:40:51.938788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 401/794] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:51 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:52.915409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:52.916042 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:52.922698 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:52.929904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:52.929904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:52.929904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:52.929904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:52.930789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:52.959827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:52.960558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:52.966845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:52.967405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:52.967912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:52.968687 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:52.969219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:52.969716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:53.057722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:53.065967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0c024e58-3307-433a-bbcf-a90bcb0748f4 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.154389 Aug 08 02:40:53.067343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 394/795] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:52 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:53.105675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:53.113166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7b59bfbb-f326-44b3-a327-46872611004d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.157772 Aug 08 02:40:53.113716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 402/796] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:52 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:54.088502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:54.089116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:54.095569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:54.096051 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:54.096487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:54.097211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:54.098302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:54.098756 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:54.113169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:54.133890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:54.134529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:54.141195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:54.141682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:54.142256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:54.142994 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:54.143454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:54.143954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:54.230177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:54.238187 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9dcf7f44-0b21-42c1-89ff-2fa0adb5c367 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.153364 Aug 08 02:40:54.238887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 395/797] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:54 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:54.276853 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:54.284505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-55f532cd-18db-4e95-ba74-97e8748f8b1f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.154670 Aug 08 02:40:54.285736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 403/798] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:54 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:55.260032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:55.260570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:55.266985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:55.267467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:55.267902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:55.268590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:55.269045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:55.270069 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:55.305960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:55.306607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:55.313101 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:55.317630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:55.317630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:55.317630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:55.317630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:55.317982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:55.404495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:55.412184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e6e8715a-ee21-4718-b54f-e3c62be068ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.156087 Aug 08 02:40:55.412770 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 396/799] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:55 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:55.456906 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:55.464414 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a0724edc-41d9-4780-b2bc-5aeb15c7888a tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.163147 Aug 08 02:40:55.464978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 404/800] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:55 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:56.433895 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:56.434584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:56.440940 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.441424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.441861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.443311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.443791 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.444216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.484848 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:56.485461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:56.492471 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.492954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.493390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.494092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.494633 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.495008 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.578909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:56.582013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2805acd7-d713-4f69-91f7-2a742f9592a2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.151907 Aug 08 02:40:56.582809 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 397/801] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:56 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:56.627963 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:56.635930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-767ef613-9e24-4716-97f8-cb4cce1b1863 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.154855 Aug 08 02:40:56.636483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 405/802] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:56 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:57.602929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:57.603540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:57.609946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:57.610482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:57.610916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:57.611631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:57.612083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:57.612502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:57.657022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:57.657640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:57.664362 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:57.664846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:57.665291 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:57.665988 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:57.666479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:57.666912 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:57.746738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:57.754204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cdb5c48e-a409-4915-87f8-93955e3870ed tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1678 microversion: 2.1 time: 0.155168 Aug 08 02:40:57.754804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 398/803] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:57 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:57.800065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:57.809951 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08bc50af-0df9-4fe9-905b-d7f3f82d8421 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.156814 Aug 08 02:40:57.810549 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 406/804] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:57 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:58.213232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:58.213715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:58.219578 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.220049 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.220475 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.221143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.221590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.222004 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.305786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lazy-loading 'services' on Instance uuid 08b62cb1-88d8-45e9-b506-339fedab711a {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:58.464919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8272b579-577b-4d33-ae50-64eb136a05e5 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments/23f48dfd-82f4-43f8-8d50-3d482421dc8d" status: 202 len: 0 microversion: 2.1 time: 0.255223 Aug 08 02:40:58.465635 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 399/805] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:40:58 2022] DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments/23f48dfd-82f4-43f8-8d50-3d482421dc8d => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:40:58.474835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:58.477640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:58.484497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.485056 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.485501 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.486205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.486691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.487116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.518303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4ec16410-2b16-4f39-bf84-8130ad1115eb tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Aug 08 02:40:58.519044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 407/806] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:40:58 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:58.777564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:58.778185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:58.784350 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.784820 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.785245 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.785918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.787077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.787500 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.831424 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:58.832136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:58.839801 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.840289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.840726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.841423 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.841874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.842299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.922837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:58.930560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a369ddbc-0acd-4f72-966f-cb90a5685f7a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1655 microversion: 2.1 time: 0.157633 Aug 08 02:40:58.931133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 400/807] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:58 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:40:58.951233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b166bfec-5df2-4222-950c-51a9bb181afb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:58.957320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b166bfec-5df2-4222-950c-51a9bb181afb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.957804 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b166bfec-5df2-4222-950c-51a9bb181afb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.959281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b166bfec-5df2-4222-950c-51a9bb181afb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.977849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:58.985828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-587d5619-0bfb-4afa-880f-f9b298e6af34 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.158559 Aug 08 02:40:58.986440 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 408/808] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:58 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:59.017494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b166bfec-5df2-4222-950c-51a9bb181afb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Going to try to start instance {{(pid=124658) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 02:40:59.209249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b166bfec-5df2-4222-950c-51a9bb181afb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action" status: 202 len: 0 microversion: 2.1 time: 0.261559 Aug 08 02:40:59.209876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 401/809] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 02:40:58 2022] POST /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:40:59.218234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:59.219236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:59.225052 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:59.225538 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:59.225977 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:59.226824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:59.227279 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:59.227705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:59.363263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:59.371444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8daf7b6a-7ff3-4a84-b4cd-6b95d34b1353 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1664 microversion: 2.1 time: 0.156855 Aug 08 02:40:59.372126 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 409/810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:40:59 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:40:59.532192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:59.535447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:59.547083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:59.547083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:59.547083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:59.547083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:59.547467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:59.547467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:59.597081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6e4618ab-2113-4cc9-8718-8d68f1cedfd1 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069173 Aug 08 02:40:59.597662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 402/811] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:40:59 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:00.006734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:00.007345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:00.013711 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.014190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.014657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.015358 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.015807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.016232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.152422 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:00.159924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7acee27f-a5a6-4f15-aa93-7608113578b7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.157383 Aug 08 02:41:00.160497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 410/812] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:00 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:00.393358 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:00.393881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:00.401024 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.401504 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.401939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.402661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.403116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.403647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.540907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:00.548404 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-552f7df9-363c-4c29-8089-8264bdf9f700 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1664 microversion: 2.1 time: 0.159128 Aug 08 02:41:00.548973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 403/813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:00 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:00.609427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:00.611628 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:00.617773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.618255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.618753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.619444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.619898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.620325 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.650014 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4c081d6b-4265-4095-a198-cc257a03216a tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044381 Aug 08 02:41:00.650519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 411/814] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:41:00 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:41:00.729130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:00.729627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:00.735495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.735973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.736434 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.737117 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.737568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.737993 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.766000 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:41:01.069287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b98ba164-9545-4e98-81fc-19e3f72129de tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 204 len: 0 microversion: 2.1 time: 0.343708 Aug 08 02:41:01.069932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 404/815] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:41:00 2022] DELETE /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:41:01.078343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:01.078983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:01.085640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.086124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.086592 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.087313 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.087770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.088201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.182420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:01.183063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:01.189043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.189531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.189967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.190691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.191149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.191573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.220743 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:01.230768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-210b00ca-3cb6-4007-b4a1-3621db201111 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1687 microversion: 2.1 time: 0.156394 Aug 08 02:41:01.231458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 412/816] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:01 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:01.338065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:01.345743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2e4ede0e-7431-4f7d-907f-850a27b4646c tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.167533 Aug 08 02:41:01.346329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 405/817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:01 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:01.375259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-465b36c6-4461-4f04-ab02-304577b0ff51 req-786ff820-8269-409e-acac-a05673666a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "name": "network-vif-plugged", "status": "completed", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:01.385295 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-465b36c6-4461-4f04-ab02-304577b0ff51 req-786ff820-8269-409e-acac-a05673666a0a service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.385762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-465b36c6-4461-4f04-ab02-304577b0ff51 req-786ff820-8269-409e-acac-a05673666a0a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.386228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-465b36c6-4461-4f04-ab02-304577b0ff51 req-786ff820-8269-409e-acac-a05673666a0a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.397476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-465b36c6-4461-4f04-ab02-304577b0ff51 req-786ff820-8269-409e-acac-a05673666a0a service nova] Creating event network-vif-plugged:2673af77-3e95-439c-83d1-409d6e88dcb5 for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 on hv-cinder-85226 Aug 08 02:41:01.402606 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-465b36c6-4461-4f04-ab02-304577b0ff51 req-786ff820-8269-409e-acac-a05673666a0a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Aug 08 02:41:01.403295 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 413/818] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:01.570152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:01.570789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:01.577163 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.577639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.578329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.579033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.579481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.579901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.706540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:01.714090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5908bf58-9f77-49fc-b97c-498a43122af9 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1668 microversion: 2.1 time: 0.148326 Aug 08 02:41:01.714684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 406/819] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:01 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:02.252039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:02.252734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:02.260141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:02.260620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:02.261094 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:02.261810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:02.262266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:02.262719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:02.366300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:02.366948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:02.372790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:02.373277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:02.373715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:02.374586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:02.375054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:02.375481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:02.398283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:02.405848 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-263ac158-a7ed-4f9f-9473-150f572a4f7e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1687 microversion: 2.1 time: 0.157984 Aug 08 02:41:02.406437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 414/820] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:02 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:02.509437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:02.516898 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-41d984a7-4787-4b5e-9080-a9706b37b8af tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.154453 Aug 08 02:41:02.517464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 407/821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:02 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:03.427754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:03.428358 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:03.434760 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:03.435237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:03.435668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:03.436352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:03.436798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:03.437219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:03.539253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:03.539994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:03.546568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:03.547052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:03.547487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:03.548180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:03.548635 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:03.549065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:03.563911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:03.571698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b8b7fdeb-f202-43e6-8140-08fd0d26cfca tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1687 microversion: 2.1 time: 0.148409 Aug 08 02:41:03.572267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 415/822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:03 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:03.684709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:03.687020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:03.692971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9327aa6d-0773-4872-a829-22c45a43f115 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.158211 Aug 08 02:41:03.693542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 408/823] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:03 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:04.593433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:04.594051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:04.600598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:04.601081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:04.601520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:04.602222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:04.602706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:04.603136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:04.713831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:04.715148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:04.722113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:04.722622 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:04.723057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:04.723752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:04.724204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:04.724655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:04.735792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:04.745868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-16031a0a-0372-4e2e-83b6-60789e1fc20e tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1687 microversion: 2.1 time: 0.156467 Aug 08 02:41:04.746467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 416/824] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:04 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:04.954714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:04.958566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d88adaa3-0440-4efa-b617-e7640b42bbc7 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.249112 Aug 08 02:41:04.959150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 409/825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:04 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:05.420964 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-50410c61-3b43-4167-81a1-c7b51d33f927 req-3cde0479-068b-4e0e-ba07-4de49e05ac56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b62cb1-88d8-45e9-b506-339fedab711a", "name": "network-vif-deleted", "tag": "02e01264-c556-4152-ab45-aa8f19b46808"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:05.431217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-50410c61-3b43-4167-81a1-c7b51d33f927 req-3cde0479-068b-4e0e-ba07-4de49e05ac56 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:05.431723 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-50410c61-3b43-4167-81a1-c7b51d33f927 req-3cde0479-068b-4e0e-ba07-4de49e05ac56 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:05.432124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-50410c61-3b43-4167-81a1-c7b51d33f927 req-3cde0479-068b-4e0e-ba07-4de49e05ac56 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:05.443196 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-50410c61-3b43-4167-81a1-c7b51d33f927 req-3cde0479-068b-4e0e-ba07-4de49e05ac56 service nova] Creating event network-vif-deleted:02e01264-c556-4152-ab45-aa8f19b46808 for instance 08b62cb1-88d8-45e9-b506-339fedab711a on hv-cinder-85226 Aug 08 02:41:05.448300 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-50410c61-3b43-4167-81a1-c7b51d33f927 req-3cde0479-068b-4e0e-ba07-4de49e05ac56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031027 Aug 08 02:41:05.448886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 417/826] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:05.767036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:05.767544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:05.774194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:05.774814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:05.775249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:05.775935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:05.776384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:05.776802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:05.844643 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:05.853288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-42a8c2a3-9b8a-4214-9f59-2f7208d51225 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 200 len: 1620 microversion: 2.1 time: 0.090046 Aug 08 02:41:05.853866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 410/827] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:05 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 1620 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:05.981249 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:05.981942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:05.987968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:05.988743 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:05.989227 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:05.990276 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:05.990762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:05.991184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:06.010715 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:06.143004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:06.152223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f1c66687-c4f6-4494-ba37-c49fedfe26cb tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1574 microversion: 2.1 time: 0.175570 Aug 08 02:41:06.152808 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 418/828] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:05 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:06.874965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:06.875570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 08b62cb1-88d8-45e9-b506-339fedab711a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:06.882247 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:06.882766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:06.883198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:06.883881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:06.884334 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:06.884759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:06.898702 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] HTTP exception thrown: Instance 08b62cb1-88d8-45e9-b506-339fedab711a could not be found. Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Request method failure captured: Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a HTTP/1.1 Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW4UlCKJdsfVo1Yrub2DfbsQUnl56LGKCg8UwvCa3txiYym0JrUsoXuW_CnUiVUildOjZo9GLYB4DgWAajQ89ZQUG0v5MQhNaqRYSpF43ngQyWSiPwaFBAzHGoBC_pEJEFhiHmHNIVrkv2ZiwY_DJTB76YyD8PuhUJJDO4vqeoBlT8 Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:41:06.900320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f1f194384993444da5c7b7f30e42746d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f6fb96d9442147e0a2201fe890d6f955 Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 08b62cb1-88d8-45e9-b506-339fedab711a could not be found. Aug 08 02:41:06.902070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '08b62cb1-88d8-45e9-b506-339fedab711a'} Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b62cb1-88d8-45e9-b506-339fedab711a could not be found. Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:41:06.902936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b62cb1-88d8-45e9-b506-339fedab711a could not be found. Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b62cb1-88d8-45e9-b506-339fedab711a could not be found. Aug 08 02:41:06.904205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:06.905362 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Returning 404 to user: Instance 08b62cb1-88d8-45e9-b506-339fedab711a could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:41:06.905362 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-61017b7e-972f-4808-b573-31d89167559f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a" status: 404 len: 111 microversion: 2.1 time: 0.030529 Aug 08 02:41:06.905362 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 411/829] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:06 2022] GET /compute/v2.1/servers/08b62cb1-88d8-45e9-b506-339fedab711a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:41:06.910627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fc39540a-1ef2-4f08-81cc-689e2c1fdcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '.version_select at 0x7fb2bea38820>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:07.008877 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fc39540a-1ef2-4f08-81cc-689e2c1fdcc4 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219070230" status: 202 len: 0 microversion: 2.1 time: 0.102025 Aug 08 02:41:07.009458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 419/830] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 02:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219070230 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:41:07.173459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:07.173985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:07.180595 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:07.181068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:07.181494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:07.182240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:07.182728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:07.183145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:07.326862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:07.335660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9bbdca20-9e35-481f-85e9-a4f217d6eb3e tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1561 microversion: 2.1 time: 0.166029 Aug 08 02:41:07.336259 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 412/831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:07 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:10.312095 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:10.312585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:10.319411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.319886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.320774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.321120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.321600 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.322021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.348862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:41:10.578756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-932bd9dc-1bb8-4c8e-8e42-15cccd7eda73 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 204 len: 0 microversion: 2.1 time: 0.270153 Aug 08 02:41:10.579380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 420/832] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:41:10 2022] DELETE /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:41:10.587477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:10.588239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:10.595828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.596369 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.596838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.597520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.597970 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.598408 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.726429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:10.734103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2b77b33b-9298-45af-9052-ccfc5f6c30ce tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1506 microversion: 2.1 time: 0.150514 Aug 08 02:41:10.734696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 413/833] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:10 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:11.765061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:11.767894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:11.771370 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:11.778216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:11.778996 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:11.779444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:11.780184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:11.780641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:11.781329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:11.808849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-e39199df-5b15-4af6-9882-821d34ed5deb req-a2f317c3-c071-41d6-b7fb-a2e0cc66d9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b383010a-a42d-40bb-87aa-88500e694738", "name": "network-vif-deleted", "tag": "b09b9826-f63f-4724-9a75-a75195d2391a"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:11.826391 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e39199df-5b15-4af6-9882-821d34ed5deb req-a2f317c3-c071-41d6-b7fb-a2e0cc66d9a7 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:11.827687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e39199df-5b15-4af6-9882-821d34ed5deb req-a2f317c3-c071-41d6-b7fb-a2e0cc66d9a7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:11.828966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e39199df-5b15-4af6-9882-821d34ed5deb req-a2f317c3-c071-41d6-b7fb-a2e0cc66d9a7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:11.848187 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-e39199df-5b15-4af6-9882-821d34ed5deb req-a2f317c3-c071-41d6-b7fb-a2e0cc66d9a7 service nova] Creating event network-vif-deleted:b09b9826-f63f-4724-9a75-a75195d2391a for instance b383010a-a42d-40bb-87aa-88500e694738 on hv-cinder-85226 Aug 08 02:41:11.855054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:11.855229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-e39199df-5b15-4af6-9882-821d34ed5deb req-a2f317c3-c071-41d6-b7fb-a2e0cc66d9a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048755 Aug 08 02:41:11.855229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 414/834] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:41:11.862619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-90248338-147e-482c-85af-86b0fd17209f tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 200 len: 1464 microversion: 2.1 time: 0.109775 Aug 08 02:41:11.863305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 421/835] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:11 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 1464 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:12.885250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:12.885936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: b383010a-a42d-40bb-87aa-88500e694738] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:12.892828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.893303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.893732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.894433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.894972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.895411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.909264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] HTTP exception thrown: Instance b383010a-a42d-40bb-87aa-88500e694738 could not be found. Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Request method failure captured: Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 HTTP/1.1 Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW4UlCKJdsfVo1Yrub2DfbsQUnl56LGKCg8UwvCa3txiYym0JrUsoXuW_CnUiVUildOjZo9GLYB4DgWAajQ89ZQUG0v5MQhNaqRYSpF43ngQyWSiPwaFBAzHGoBC_pEJEFhiHmHNIVrkv2ZiwY_DJTB76YyD8PuhUJJDO4vqeoBlT8 Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:41:12.913772 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f1f194384993444da5c7b7f30e42746d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f6fb96d9442147e0a2201fe890d6f955 Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance b383010a-a42d-40bb-87aa-88500e694738 could not be found. Aug 08 02:41:12.915275 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'b383010a-a42d-40bb-87aa-88500e694738'} Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b383010a-a42d-40bb-87aa-88500e694738 could not be found. Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:41:12.916126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b383010a-a42d-40bb-87aa-88500e694738 could not be found. Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b383010a-a42d-40bb-87aa-88500e694738 could not be found. Aug 08 02:41:12.917537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:41:12.918966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Returning 404 to user: Instance b383010a-a42d-40bb-87aa-88500e694738 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:41:12.918966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-215135e7-2213-4d8a-ad0b-fe131a6c4456 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738" status: 404 len: 111 microversion: 2.1 time: 0.032071 Aug 08 02:41:12.918966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 415/836] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:12 2022] GET /compute/v2.1/servers/b383010a-a42d-40bb-87aa-88500e694738 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:41:12.921614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:12.922116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:12.929652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.930132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.930599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.937245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.937245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.937245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.957494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:41:13.217068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-107c6b9a-3efe-4ce1-9717-97e8b486f4ec tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 204 len: 0 microversion: 2.1 time: 0.299111 Aug 08 02:41:13.217575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 422/837] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:41:12 2022] DELETE /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:41:13.226224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:13.226849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:13.233612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.234089 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.234560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.235238 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.235685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.236103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.369723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:13.377182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7781cb3a-db36-495f-9d7d-cb54ef3ef4ef tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.155405 Aug 08 02:41:13.377730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 416/838] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:13 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:14.399334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:14.400138 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:14.406784 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.407276 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.407710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.408400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.408846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.409264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.550092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fb96d9442147e0a2201fe890d6f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f194384993444da5c7b7f30e42746d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:14.559880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e555e41b-fa5f-43c6-b1d5-429ef33f2638 tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 200 len: 1520 microversion: 2.1 time: 0.165514 Aug 08 02:41:14.564524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 423/839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:14 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:14.593231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-99eaacd1-3fb5-42aa-bdb1-6f7033c94358 req-47b978c9-1a52-47e4-992d-0423ed569214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4449d47c-fbac-4e23-8017-0a283a5ba7d9", "name": "network-vif-deleted", "tag": "b02fabe8-9ace-422a-a568-18c37daa63c2"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:14.604041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-99eaacd1-3fb5-42aa-bdb1-6f7033c94358 req-47b978c9-1a52-47e4-992d-0423ed569214 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.610309 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-99eaacd1-3fb5-42aa-bdb1-6f7033c94358 req-47b978c9-1a52-47e4-992d-0423ed569214 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.610309 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-99eaacd1-3fb5-42aa-bdb1-6f7033c94358 req-47b978c9-1a52-47e4-992d-0423ed569214 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.616088 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-99eaacd1-3fb5-42aa-bdb1-6f7033c94358 req-47b978c9-1a52-47e4-992d-0423ed569214 service nova] Creating event network-vif-deleted:b02fabe8-9ace-422a-a568-18c37daa63c2 for instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 on hv-cinder-85226 Aug 08 02:41:14.621108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-99eaacd1-3fb5-42aa-bdb1-6f7033c94358 req-47b978c9-1a52-47e4-992d-0423ed569214 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Aug 08 02:41:14.621703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 417/840] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:15.581387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:15.582090 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] [instance: 4449d47c-fbac-4e23-8017-0a283a5ba7d9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:15.588737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:15.589224 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:15.589672 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:15.590869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:15.591333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:15.591761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:15.605203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] HTTP exception thrown: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 could not be found. Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Request method failure captured: Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 HTTP/1.1 Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW4UlCKJdsfVo1Yrub2DfbsQUnl56LGKCg8UwvCa3txiYym0JrUsoXuW_CnUiVUildOjZo9GLYB4DgWAajQ89ZQUG0v5MQhNaqRYSpF43ngQyWSiPwaFBAzHGoBC_pEJEFhiHmHNIVrkv2ZiwY_DJTB76YyD8PuhUJJDO4vqeoBlT8 Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:41:15.606895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f1f194384993444da5c7b7f30e42746d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f1f194384993444da5c7b7f30e42746d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: f1f194384993444da5c7b7f30e42746d Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-835005575 Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f6fb96d9442147e0a2201fe890d6f955 Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-835005575-project Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 could not be found. Aug 08 02:41:15.608438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '4449d47c-fbac-4e23-8017-0a283a5ba7d9'} Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 could not be found. Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:41:15.609288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 could not be found. Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 could not be found. Aug 08 02:41:15.610498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:41:15.611639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] Returning 404 to user: Instance 4449d47c-fbac-4e23-8017-0a283a5ba7d9 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:41:15.611639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9e528922-646a-4956-8867-a220729852ad tempest-ServerRescueNegativeTestJSON-835005575 tempest-ServerRescueNegativeTestJSON-835005575-project] 10.222.0.15 "GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9" status: 404 len: 111 microversion: 2.1 time: 0.031072 Aug 08 02:41:15.611639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 424/841] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:15 2022] GET /compute/v2.1/servers/4449d47c-fbac-4e23-8017-0a283a5ba7d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:41:50.020790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:50.021385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:50.023534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:50.024210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=39 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:50.029214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:50.029691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:50.030121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:50.031077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:50.031531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:50.031954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:50.054390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1f6de4c2-6955-4c79-a2e3-169a3cba51ef tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/ips" status: 200 len: 152 microversion: 2.20 time: 0.038047 Aug 08 02:41:50.054957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 418/842] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Aug 8 02:41:50 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:41:52.216281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:52.216835 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:52.219487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:52.220141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:52.224700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:52.225178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:52.225615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:52.226298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:52.226773 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:52.227196 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:52.251662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lazy-loading 'flavor' on Instance uuid 9af55837-b03e-4343-9650-3adfa1bdceec {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:41:52.732623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c0a13807-295a-4e0c-9bb7-65007690a3a4 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/action" status: 202 len: 0 microversion: 2.20 time: 0.520146 Aug 08 02:41:52.733434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 425/843] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 02:41:52 2022] POST /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:41:52.742092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:52.742815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:52.755910 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:52.761616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:52.761616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:52.761616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:52.761616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:52.761969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:52.895766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:52.904313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:52.906327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:52.907653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7cd8873c-4402-408b-bd7d-25d8b0b9e652 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.169346 Aug 08 02:41:52.908207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 419/844] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:52 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:53.932116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:53.932809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:53.939799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:53.940373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:53.940811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:53.941497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:53.941950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:53.942394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:54.081414 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:54.089337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:54.090868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:54.092023 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-81e6f7aa-3bde-4647-b3a8-4f830939de8b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.164682 Aug 08 02:41:54.092579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 426/845] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:53 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:55.115205 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:55.115914 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:55.122447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:55.122921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:55.123349 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:55.124031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:55.124476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:55.124890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:55.257823 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:55.265778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:55.267908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:55.269061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2d2915d5-6014-4f86-9534-2ec086a7feeb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.157726 Aug 08 02:41:55.269608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 420/846] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:55 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:56.292833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:56.293449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:56.300707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:56.301189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:56.301628 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:56.302391 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:56.302849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:56.303303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:56.436795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:56.445755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:56.447292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:56.448455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-13d9a68f-3f20-4c15-8efc-3bedff27b195 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.159577 Aug 08 02:41:56.449002 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 427/847] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:56 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:57.471771 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:57.472500 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:57.479160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:57.479645 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:57.480077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:57.480795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:57.481248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:57.481670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:57.614561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:57.622651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:57.624146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:57.625405 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7bf88100-42ef-404b-9af9-ffcdee6f31fe tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.158110 Aug 08 02:41:57.625992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 421/848] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:57 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:58.648037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:58.648669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:58.655672 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:58.656165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:58.656654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:58.657388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:58.657841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:58.658267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:58.941805 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:58.949688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:58.951232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:58.952664 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9a23324e-9156-4bfa-9299-8ea0495d473c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.308266 Aug 08 02:41:58.953206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 428/849] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:58 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:59.974979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:59.975635 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:59.982280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:59.982794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:59.983229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:59.983920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:59.984374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:59.984897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:00.120697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:00.129076 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:00.130691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:00.131844 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1f7ca27b-1ea2-41bb-9166-97fa06b31dcf tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.160892 Aug 08 02:42:00.132405 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 422/850] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:59 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:01.155267 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:01.155898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:01.162311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:01.162879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:01.163329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:01.164017 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:01.164472 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:01.164897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:01.299627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:01.307585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:01.309069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:01.310208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-44c2e803-5edf-4c67-b347-ad59d6860689 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.158917 Aug 08 02:42:01.310786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 429/851] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:01 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:02.334259 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:02.335013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:02.341311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:02.341788 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:02.342214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:02.342939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:02.343393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:02.343811 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:02.477357 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:02.485426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:02.487008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:02.488144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-287dbfe3-c9c3-4039-a541-13b12ebd6154 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.158663 Aug 08 02:42:02.488711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 423/852] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:02 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:03.511358 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:03.514397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:03.518378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:03.518867 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:03.519298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:03.520003 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:03.520451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:03.521428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:03.653121 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:03.660928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:03.662547 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:03.663689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6d1a6d7e-809b-45c1-83ea-c70dd30dc625 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.156147 Aug 08 02:42:03.664235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 430/853] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:03 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:04.687216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:04.687828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:04.694787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:04.695317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:04.695748 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:04.696437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:04.696892 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:04.697314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:04.827390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:04.836086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:04.837572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:04.838781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4bf64a87-ad75-4cd2-aac6-a191b4d218f5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.155634 Aug 08 02:42:04.839332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 424/854] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:04 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:05.861137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:05.861758 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:05.868310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:05.868792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:05.869232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:05.869926 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:05.870404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:05.870836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:06.001352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:06.009609 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:06.011157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:06.012314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fa4deb9f-1c55-4fe5-9226-67a0f7deab4e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.155207 Aug 08 02:42:06.012859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 431/855] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:05 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:07.035778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:07.036945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:07.043450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:07.043909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:07.044340 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:07.045022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:07.045474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:07.045897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:07.173423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:07.181941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:07.183399 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:07.184552 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c90083c5-6923-434c-b52f-1ad31393474f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.152709 Aug 08 02:42:07.185114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 425/856] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:07 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:07.782004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-c4adaabe-7d19-46ba-bd65-4eb34c151e1b req-20d8a9dc-24af-4c87-baba-c4b5b4e1c7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "name": "network-vif-plugged", "status": "completed", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:07.792436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c4adaabe-7d19-46ba-bd65-4eb34c151e1b req-20d8a9dc-24af-4c87-baba-c4b5b4e1c7c3 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:07.798116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c4adaabe-7d19-46ba-bd65-4eb34c151e1b req-20d8a9dc-24af-4c87-baba-c4b5b4e1c7c3 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:07.798116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c4adaabe-7d19-46ba-bd65-4eb34c151e1b req-20d8a9dc-24af-4c87-baba-c4b5b4e1c7c3 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:07.804550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-c4adaabe-7d19-46ba-bd65-4eb34c151e1b req-20d8a9dc-24af-4c87-baba-c4b5b4e1c7c3 service nova] Creating event network-vif-plugged:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:42:07.809675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-c4adaabe-7d19-46ba-bd65-4eb34c151e1b req-20d8a9dc-24af-4c87-baba-c4b5b4e1c7c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Aug 08 02:42:07.810534 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 432/857] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:08.207352 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:08.207912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:08.214323 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:08.214839 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:08.215277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:08.215973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:08.216427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:08.216850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:08.342400 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:08.351157 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:08.352978 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:08.354137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f056d640-63d6-40cc-8065-2add8e3813db tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.150738 Aug 08 02:42:08.354766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 426/858] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:08 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:09.377776 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:09.378495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:09.385299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:09.385771 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:09.386202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:09.386911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:09.387359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:09.387777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:09.515409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:09.523838 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:09.525343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:09.526535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b7658411-b263-43c6-aec1-c7779f5591ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.152930 Aug 08 02:42:09.527082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 433/859] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:09 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:10.359685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:10.361878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:10.368982 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.370508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.370508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.370764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.371220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.371647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.401184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ebb23d62-ae55-4b0a-94b7-f4654cd095bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045445 Aug 08 02:42:10.401755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 427/860] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:42:10 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:42:10.463360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:10.463892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:10.470115 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.470689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.471124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.471806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.472256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.472678 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.499669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:42:10.549143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:10.549749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:10.556322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.556740 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.557192 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.557861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.558312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.558759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.690331 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:10.698621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:10.701506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:10.701506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-60d37b6a-d77c-4c63-9c09-e07b20190ec7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.155973 Aug 08 02:42:10.702317 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 428/861] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:10 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:10.754851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7e537a77-c9bf-4901-8248-cddcce230550 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 204 len: 0 microversion: 2.1 time: 0.295001 Aug 08 02:42:10.755470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 434/862] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:42:10 2022] DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:42:10.763396 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:10.764091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:10.770017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.770562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.770979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.771669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:10.772123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:10.772551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:10.903017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:10.910637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-13b031b2-fb1e-4843-be35-f2236a432e4c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1674 microversion: 2.1 time: 0.150843 Aug 08 02:42:10.911717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 429/863] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:10 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:11.725596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:11.726286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:11.732764 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:11.733240 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:11.733677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:11.734434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:11.734891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:11.735315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:11.870440 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:11.878690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:11.881349 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:11.881605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-90781892-a736-46d1-926d-c5a4d1c40628 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.160799 Aug 08 02:42:11.882478 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 435/864] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:11 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:11.932465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:11.933077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:11.939531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:11.940015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:11.940453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:11.941145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:11.941612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:11.942040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:12.071556 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:12.079342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9aa98c56-bcfd-4d75-9845-0b0248db135a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1674 microversion: 2.1 time: 0.150778 Aug 08 02:42:12.079908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 430/865] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:11 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:12.904939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:12.905541 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:12.912243 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:12.912729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:12.913169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:12.915473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:12.915949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:12.916395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:13.058964 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:13.067674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:13.069279 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:13.070508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f9cc81aa-eaad-4222-ac1f-4e83599be462 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.169498 Aug 08 02:42:13.071071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 436/866] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:12 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:13.101098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:13.101821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:13.108547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:13.109015 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:13.109470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:13.110162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:13.110644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:13.111060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:13.539935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:13.545605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-318a5e1d-b1cf-4bad-9992-214afc3826a8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1674 microversion: 2.1 time: 0.449234 Aug 08 02:42:13.546182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 431/867] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:13 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1674 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:13.998117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-cf5a1ee7-e7f7-4b31-97d3-37724487af22 req-8a279d2e-7e98-4845-acb1-405568df11e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ed21ea-bc5e-4251-bcc7-fbfe640ab747", "name": "network-vif-deleted", "tag": "fdd841cc-5aaf-433c-8961-a1c99eafc2ff"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:14.013324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-cf5a1ee7-e7f7-4b31-97d3-37724487af22 req-8a279d2e-7e98-4845-acb1-405568df11e8 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:14.014445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-cf5a1ee7-e7f7-4b31-97d3-37724487af22 req-8a279d2e-7e98-4845-acb1-405568df11e8 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:14.015128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-cf5a1ee7-e7f7-4b31-97d3-37724487af22 req-8a279d2e-7e98-4845-acb1-405568df11e8 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:14.030281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-cf5a1ee7-e7f7-4b31-97d3-37724487af22 req-8a279d2e-7e98-4845-acb1-405568df11e8 service nova] Creating event network-vif-deleted:fdd841cc-5aaf-433c-8961-a1c99eafc2ff for instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 on hv-cinder-85226 Aug 08 02:42:14.036418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-cf5a1ee7-e7f7-4b31-97d3-37724487af22 req-8a279d2e-7e98-4845-acb1-405568df11e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041560 Aug 08 02:42:14.040182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 437/868] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:14.095083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:14.095762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:14.103344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:14.103995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:14.104279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:14.105236 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:14.105694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:14.106285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:14.267573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:14.277103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:14.282471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:14.282471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8d2298a0-c631-40c7-8647-15cd86b4a6dc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.188687 Aug 08 02:42:14.282471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 432/869] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:14 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:14.568290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:14.568992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:14.575308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:14.575791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:14.576265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:14.577223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:14.577679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:14.578106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:14.610212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:14.610733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:14.611171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:14.611614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lazy-loading 'fault' on Instance uuid 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:14.654238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:14.657754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:14.662863 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7e86969a-47ef-45d1-9326-26d9a2ba9416 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 200 len: 1328 microversion: 2.1 time: 0.099126 Aug 08 02:42:14.663653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 438/870] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:14 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:15.303001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:15.303521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:15.309871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:15.310367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:15.310801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:15.311479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:15.311926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:15.312341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:15.443887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:15.451666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:15.453416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:15.454585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dc3e94a8-e1c4-478f-9ea1-a1faa0354390 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1743 microversion: 2.20 time: 0.155580 Aug 08 02:42:15.455145 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 433/871] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:15 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:15.684360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:15.684901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:15.691905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:15.692244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:15.693411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:15.694127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:15.694616 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:15.695048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:15.709634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] HTTP exception thrown: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Request method failure captured: Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 HTTP/1.1 Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HZpqzG9MJ5b3xPR1Tw-Jd1pREl-LmVgokPVon9k-Qu54bJ59GSD2xDa8eS98wRa1k7BKv4sMlDdTLENwRM64msbpwRMu95nJ_Jyg4s_PokH4pUZIIawpq9wsDsI3OKb9C1iO9A3NH7DHUlBbpO2eID6RmbkXhIx5k3Zzwg_jmnv6HU Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:42:15.711359 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_897030a5075b4ca3ad29d73371306a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 55afeedd651248da8ac80c61fb0729cc Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:42:15.713054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '06ed21ea-bc5e-4251-bcc7-fbfe640ab747'} Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:42:15.714047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:42:15.715612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:42:15.717264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Returning 404 to user: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:42:15.717264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2104925e-b298-4849-b574-fcd2ebfee815 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 404 len: 111 microversion: 2.1 time: 0.032778 Aug 08 02:42:15.717264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 439/872] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:15 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:42:15.728758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-140fbab8-d0ce-45ee-b0ef-4d3d9c22ea2c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '.version_select at 0x7fb2b9f48790>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:15.802453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-140fbab8-d0ce-45ee-b0ef-4d3d9c22ea2c tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669914246" status: 202 len: 0 microversion: 2.1 time: 0.079411 Aug 08 02:42:15.803041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 434/873] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 02:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669914246 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:42:16.488220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:16.489511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:16.500581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:16.501367 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:16.503936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:16.503936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:16.503936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:16.503936 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:16.618569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d8a5fe47-6686-48e4-b4fd-323e2f98b47d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: .version_select at 0x7fb2ba00d700>, body: {"keypair": {"name": "tempest-keypair-844500154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE77vIme7yQQOCMzDkSfIdbtUZ1K0Gebxi55uHTfBU7LAV13GSZZZ+ADhe1V5rsg3rIhef0KyLQUE6HI+c+lAfEzWwOfSsGZSy4ro+oF6t74EA2eVRR4w6GOXg4F+E4ovA=="}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:16.764525 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:16.775033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:16.776976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:16.778450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4af2c0aa-64f8-4d04-a86e-fe520279ad31 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.304831 Aug 08 02:42:16.795256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 440/874] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:16 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:16.843461 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d8a5fe47-6686-48e4-b4fd-323e2f98b47d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for project 897030a5075b4ca3ad29d73371306a66. Resources: {'key_pairs'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:42:16.848851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d8a5fe47-6686-48e4-b4fd-323e2f98b47d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for user 55afeedd651248da8ac80c61fb0729cc and project 897030a5075b4ca3ad29d73371306a66. Resources: {'key_pairs'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:42:16.921542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d8a5fe47-6686-48e4-b4fd-323e2f98b47d tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.307961 Aug 08 02:42:16.922178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 435/875] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:42:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:42:17.806316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:17.807590 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:17.815375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:17.816141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:17.816785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:17.819618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:17.820308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:17.820932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:18.002879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:18.015024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:18.016524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:18.017667 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fcb754e4-cbf2-4616-a84a-a4f13079d108 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.216832 Aug 08 02:42:18.030427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 441/876] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:17 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:19.044650 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:19.045252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:19.051385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:19.052032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:19.052792 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:19.054273 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:19.054975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:19.055394 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:19.213279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:19.217478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:19.222406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:19.225887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:19.227124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7cd7211c-d9ab-4e93-9c62-2ace77df04a8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.188902 Aug 08 02:42:19.227854 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 436/877] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:19 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:19.467643 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-438163185", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "682376b8-1891-42b8-8562-21125b626ab2"}], "security_groups": [{"name": "tempest-securitygroup--1607434852"}], "key_name": "tempest-keypair-844500154", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:19.573321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] validate_networks() for [('682376b8-1891-42b8-8562-21125b626ab2', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:42:20.006145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:42:20.006584 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:42:20.007054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:42:20.008728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:42:20.008728 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:42:20.039860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:20.039860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:20.039860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:20.039860 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:20.040162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:20.040162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:20.040162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for project 897030a5075b4ca3ad29d73371306a66. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:42:20.047603 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Getting quotas for user 55afeedd651248da8ac80c61fb0729cc and project 897030a5075b4ca3ad29d73371306a66. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:42:20.061737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:42:20.064599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:42:20.252428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:20.252998 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:20.260712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:20.261208 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:20.261637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:20.262370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:20.263000 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:20.263487 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:20.396369 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:20.404372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:20.405847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:20.407013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-24ce0c03-ca8c-4d64-b3b2-06ef8d9dc5e5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.158980 Aug 08 02:42:20.407589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 437/878] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:20 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:20.531374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ed40affb-d855-41a8-a3bd-6e6bddf72348 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.067897 Aug 08 02:42:20.538278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 442/879] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:42:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:42:20.543520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3e419415-b1e3-48a5-9bb3-348d163c3c95 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:20.544130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3e419415-b1e3-48a5-9bb3-348d163c3c95 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:20.602459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3e419415-b1e3-48a5-9bb3-348d163c3c95 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:20.612936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3e419415-b1e3-48a5-9bb3-348d163c3c95 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1236 microversion: 2.1 time: 0.070273 Aug 08 02:42:20.615349 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 438/880] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:20 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:21.430770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:21.431447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:21.450311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:21.450311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:21.451596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:21.453725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:21.455263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:21.456479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:21.636905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:21.638030 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:21.645728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:21.646391 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:21.647233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:21.647872 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:21.648762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:21.649386 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:21.653575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:21.656527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:21.658400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:21.659600 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3c208619-c870-4319-8c98-d049ec11f606 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.233135 Aug 08 02:42:21.675524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 443/881] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:21 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:21.731195 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:21.741540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f440a566-ffd3-41c5-a923-5840bb067751 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1240 microversion: 2.1 time: 0.108777 Aug 08 02:42:21.742107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 439/882] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:21 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:22.768779 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:22.774582 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:22.787911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:22.789313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:22.790448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:22.795381 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:22.796330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:22.799957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:23.001937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:23.012826 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-50758b3c-9d86-4b97-9afd-48df8ec72ab2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1296 microversion: 2.1 time: 0.249789 Aug 08 02:42:23.015855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 440/883] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:22 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1296 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:23.112174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:23.113034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:23.119561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:23.121195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:23.126212 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:23.131050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:23.133576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:23.135641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:23.137258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:23.306390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:23.314630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:23.316364 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:23.317729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f92a5f6-fd8b-4e42-bfb5-f741b37a4882 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.636603 Aug 08 02:42:23.318462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 444/884] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:22 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:24.042989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:24.042989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:24.044797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:24.050081 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:24.050942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:24.051407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:24.052127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:24.052587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:24.053013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:24.313737 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:24.321668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8d6e5e04-7451-44d3-8f5f-f44d5fa5e8c1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.284041 Aug 08 02:42:24.322241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 441/885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:24 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:24.342541 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:24.343145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:24.349963 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:24.350489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:24.350924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:24.351623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:24.352072 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:24.352495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:24.484411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:24.493257 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:24.495232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:24.496679 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8be0677f-8beb-407e-9427-fc6b6fb1cfa6 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.158298 Aug 08 02:42:24.497382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 445/886] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:24 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:24.997508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-1f5a14b5-ec5a-4c03-b261-8e21af18e28f req-bcedf0b1-a5b6-4a2b-b87d-31ffce73dad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2da221-88bf-462d-937d-649c2a8e611a", "tag": "0a4c4aaf-6038-4884-b9e4-69e81091d8c2"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:25.042423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-1f5a14b5-ec5a-4c03-b261-8e21af18e28f req-bcedf0b1-a5b6-4a2b-b87d-31ffce73dad6 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:25.042917 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-1f5a14b5-ec5a-4c03-b261-8e21af18e28f req-bcedf0b1-a5b6-4a2b-b87d-31ffce73dad6 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:25.043354 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-1f5a14b5-ec5a-4c03-b261-8e21af18e28f req-bcedf0b1-a5b6-4a2b-b87d-31ffce73dad6 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:25.077177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-1f5a14b5-ec5a-4c03-b261-8e21af18e28f req-bcedf0b1-a5b6-4a2b-b87d-31ffce73dad6 service nova] Creating event network-changed:0a4c4aaf-6038-4884-b9e4-69e81091d8c2 for instance 1e2da221-88bf-462d-937d-649c2a8e611a on hv-cinder-85226 Aug 08 02:42:25.083890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-1f5a14b5-ec5a-4c03-b261-8e21af18e28f req-bcedf0b1-a5b6-4a2b-b87d-31ffce73dad6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089072 Aug 08 02:42:25.085164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 442/887] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:42:25.343681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:25.344574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:25.351714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:25.352515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:25.353012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:25.353810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:25.354328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:25.354983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:25.509514 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:25.519583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-58d58704-0ed4-488f-b7c5-35fccd7ddd3a tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.179524 Aug 08 02:42:25.521011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 446/888] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:25 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:25.536403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:25.537412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:25.545149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:25.546125 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:25.546840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:25.547787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:25.548342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:25.548991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:25.813306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:25.824374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:25.829033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:25.829033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6111e0a7-62d5-4432-9b89-be91c5f560ee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.311269 Aug 08 02:42:25.843330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 443/889] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:25 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:26.542072 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:26.542827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:26.549755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:26.554319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:26.554842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:26.555666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:26.556307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:26.556861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:26.691378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:26.699324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e655dbbf-de30-4056-97be-d4aa58ac0de3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.161587 Aug 08 02:42:26.700304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 447/890] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:26 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:26.852932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:26.853470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:26.862406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:26.863321 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:26.863808 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:26.865282 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:26.865802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:26.866231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:27.008732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:27.017182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:27.019184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:27.019854 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3c24d87d-b390-4282-9956-7a66532cc08c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.171810 Aug 08 02:42:27.020746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 444/891] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:26 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:27.721285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:27.721903 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:27.728966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:27.729450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:27.729886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:27.730612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:27.731124 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:27.731550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:27.868421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:27.876256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b8b19581-86e4-4f02-b32a-ba0b5fd02e47 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.159036 Aug 08 02:42:27.876817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 448/892] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:27 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:28.043741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:28.044352 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:28.051047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:28.051532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:28.051965 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:28.052652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:28.053110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:28.053534 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:28.446682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:28.454954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:28.456436 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:28.458216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-86aaea6d-e8c3-4790-9045-cf5062bf8b96 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.417939 Aug 08 02:42:28.459046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 445/893] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:28 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:28.898952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:28.900157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:28.907161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:28.907817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:28.908424 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:28.909114 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:28.909731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:28.910446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:29.061253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:29.071877 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2a42ee04-49a6-4ef6-8ad0-627d88986801 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.177367 Aug 08 02:42:29.072929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 449/894] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:28 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:29.480758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:29.481365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:29.487902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:29.488378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:29.488849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:29.489651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:29.490102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:29.490558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:29.620284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:29.628310 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:29.629921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:29.631212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94563a00-e0a7-4eb4-96dd-721880a234da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.154358 Aug 08 02:42:29.631800 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 446/895] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:29 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:30.094590 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:30.095199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:30.097446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:30.100952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:30.105880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:30.106371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:30.109127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:30.109127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:30.109127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:30.109127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:30.237140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:30.245092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1b321f5e-2de4-4945-86c9-83da5c0a66f7 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.154388 Aug 08 02:42:30.245654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 450/896] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:30 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:30.653845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:30.654510 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:30.657019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:30.662432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:30.662878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:30.666666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:30.666666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:30.666666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:30.666666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:30.798217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:30.808824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:30.810473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:30.811752 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9d354855-14fd-4ef7-9bfa-2ce56bdc8861 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.161756 Aug 08 02:42:30.812312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 447/897] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:30 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:31.267207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:31.267820 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:31.274761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:31.275185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:31.275617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:31.276307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:31.276762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:31.277187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:31.408941 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:31.417036 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8b0037ef-e343-470e-94c7-bd5e1eef67b8 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.153720 Aug 08 02:42:31.417593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 451/898] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:31 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:31.835920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:31.836446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:31.842975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:31.843449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:31.843875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:31.844567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:31.845011 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:31.845429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:31.976282 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:31.984220 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:31.985738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:31.987026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-da8d55fb-2ca3-4850-ba97-9d8fe2d2cbf8 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.155777 Aug 08 02:42:31.987587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 448/899] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:31 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:32.437034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:32.437649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:32.444697 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:32.445177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:32.445612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:32.446304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:32.446792 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:32.447219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:32.573881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:32.581475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-41a481bd-4ab8-484b-bbb4-be3efd7e4ffb tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.148259 Aug 08 02:42:32.582037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 452/900] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:32 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:33.009473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:33.010008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:33.016479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:33.016962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:33.017426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:33.018121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:33.018608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:33.019038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:33.156373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:33.166072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:33.167955 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:33.169234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-28405150-b954-4056-84dc-1358627ad387 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.163753 Aug 08 02:42:33.169902 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 449/901] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:33 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:33.601577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:33.602144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:33.608638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:33.609120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:33.609555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:33.610241 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:33.610726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:33.611144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:33.761666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:33.770485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1a03dccd-20b9-4014-8a41-2f8b9f0294af tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.172780 Aug 08 02:42:33.770782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 453/902] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:33 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:34.198932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:34.199483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:34.206043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:34.206560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:34.207003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:34.207700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:34.208194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:34.208625 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:34.336893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:34.344991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:34.346531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:34.347682 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4382e90c-a87e-44b0-a68a-d60dd4ad84ec tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.152784 Aug 08 02:42:34.348238 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 450/903] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:34 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:34.791413 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:34.792031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:34.798447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:34.798932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:34.799373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:34.800066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:34.800523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:34.800954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:34.934203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:34.941583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-707264ae-0117-44e7-9541-22f980d6ca39 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.154072 Aug 08 02:42:34.942134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 454/904] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:34 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:35.371322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:35.371927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:35.378241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:35.378768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:35.379198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:35.381074 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:35.381532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:35.381954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:35.511368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:35.519106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:35.520650 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:35.521865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7a8b7d7b-bfbf-41eb-8524-8d9cf580fa00 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.154468 Aug 08 02:42:35.522427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 451/905] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:35 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:35.964006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:35.964632 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:35.971876 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:35.972395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:35.973013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:35.974723 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:35.975021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:35.975303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:36.109513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:36.116953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-81416cd0-d29c-474d-8fed-5636c793cdc6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.156845 Aug 08 02:42:36.117516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 455/906] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:35 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:36.545064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:36.545661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:36.553064 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:36.553541 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:36.553978 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:36.554837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:36.555395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:36.555818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:36.687003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:36.695865 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:36.697365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:36.698570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fa318751-fb78-46f6-afab-578e8c2f607c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1738 microversion: 2.20 time: 0.157423 Aug 08 02:42:36.699132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 452/907] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:36 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:37.136925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:37.137533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:37.143868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:37.144348 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:37.144781 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:37.145520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:37.145925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:37.146363 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:37.276561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:37.279915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:37.284226 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e90b331e-92cb-4d37-9ad6-53b3cac370c2 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.151109 Aug 08 02:42:37.284794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 456/908] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:37 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:37.721190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:37.721905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:37.730074 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:37.730675 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:37.731107 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:37.731812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:37.732262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:37.732753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:37.942422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:37.948713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-bf4922dd-f9b6-47cf-a9ca-68d11263c5e9 req-4bc08e7e-acd2-4d58-b28f-bd74b1ec8a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2da221-88bf-462d-937d-649c2a8e611a", "name": "network-vif-plugged", "status": "completed", "tag": "0a4c4aaf-6038-4884-b9e4-69e81091d8c2"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:37.949847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:37.951839 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:37.953656 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-353fbb40-77e1-4d81-b757-7b3d47283d60 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1720 microversion: 2.20 time: 0.236472 Aug 08 02:42:37.963033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-bf4922dd-f9b6-47cf-a9ca-68d11263c5e9 req-4bc08e7e-acd2-4d58-b28f-bd74b1ec8a22 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:37.963588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-bf4922dd-f9b6-47cf-a9ca-68d11263c5e9 req-4bc08e7e-acd2-4d58-b28f-bd74b1ec8a22 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:37.964025 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-bf4922dd-f9b6-47cf-a9ca-68d11263c5e9 req-4bc08e7e-acd2-4d58-b28f-bd74b1ec8a22 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:37.967207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 453/909] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:37 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:37.975975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-bf4922dd-f9b6-47cf-a9ca-68d11263c5e9 req-4bc08e7e-acd2-4d58-b28f-bd74b1ec8a22 service nova] Creating event network-vif-plugged:0a4c4aaf-6038-4884-b9e4-69e81091d8c2 for instance 1e2da221-88bf-462d-937d-649c2a8e611a on hv-cinder-85226 Aug 08 02:42:37.981325 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-bf4922dd-f9b6-47cf-a9ca-68d11263c5e9 req-4bc08e7e-acd2-4d58-b28f-bd74b1ec8a22 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037470 Aug 08 02:42:37.981919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 457/910] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:38.305478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:38.306109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:38.312619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:38.312619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:38.312936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:38.313589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:38.314240 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:38.314850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:38.449937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:38.457708 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d013646d-9f23-42f5-8b6b-4bbe743f65db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.156146 Aug 08 02:42:38.459102 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 454/911] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:38 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:38.979362 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:38.980136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:38.986480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:38.987009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:38.987451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:38.988228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:38.988636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:38.989175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:39.123968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:39.132740 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:39.134446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:39.135613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d52e470d-47e1-428e-8864-11ccf824c138 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1720 microversion: 2.20 time: 0.161201 Aug 08 02:42:39.136165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 458/912] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:38 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:39.479407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:39.480016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:39.485926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:39.486441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:39.486886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:39.487570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:39.488022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:39.488443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:39.492956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=100 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:39.663115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:39.673125 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b39cb1d9-9e08-4aec-840b-aac44385798b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.198041 Aug 08 02:42:39.676057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 455/913] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:39 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:39.997755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-472275b6-d179-43f3-a13d-ce960146efcb req-f4957d42-75b4-4703-8d4e-9134cdd57460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "name": "network-vif-unplugged", "status": "completed", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:40.021027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-472275b6-d179-43f3-a13d-ce960146efcb req-f4957d42-75b4-4703-8d4e-9134cdd57460 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.021514 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-472275b6-d179-43f3-a13d-ce960146efcb req-f4957d42-75b4-4703-8d4e-9134cdd57460 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.021993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-472275b6-d179-43f3-a13d-ce960146efcb req-f4957d42-75b4-4703-8d4e-9134cdd57460 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.036301 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-472275b6-d179-43f3-a13d-ce960146efcb req-f4957d42-75b4-4703-8d4e-9134cdd57460 service nova] Creating event network-vif-unplugged:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:42:40.042077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-472275b6-d179-43f3-a13d-ce960146efcb req-f4957d42-75b4-4703-8d4e-9134cdd57460 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048046 Aug 08 02:42:40.043028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 459/914] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:42:40.158776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:40.163383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:40.166376 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.166866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.167330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.168027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.168480 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.169058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.302738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:40.311316 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:40.312807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:40.313957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-aa8961f0-aa44-48bc-b8d1-b9278e7fa309 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1723 microversion: 2.20 time: 0.159306 Aug 08 02:42:40.314542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 456/915] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:40 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:40.337896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8105c5b0-897e-4119-9a8d-b97e0706da08"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:40.340354 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:40.346640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.347122 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.347561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.348253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.348753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.349253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.695305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:40.695906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:40.702587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.707853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.707853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.707853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:40.707853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:40.708251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:40.840442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:40.851515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-2dd6048e-3e35-4735-89cc-9698f98d7394 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1362 microversion: 2.1 time: 0.156688 Aug 08 02:42:40.851515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 457/916] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:40 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:41.199911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-39c68167-8ed1-4742-81ea-e4a3dd3aa658 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.866705 Aug 08 02:42:41.204817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 460/917] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Aug 8 02:42:40 2022] POST /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-volume_attachments => generated 188 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:42:41.323840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:41.324266 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:41.330783 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:41.336270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:41.336270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:41.336270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:41.336270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:41.336692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:41.870091 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:41.870652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:41.876532 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:41.879793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:41.879793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:41.879793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:41.879793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:41.880168 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:41.896617 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b413381d-b36a-4824-8101-666ce595b2e3 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-volume_attachments/8105c5b0-897e-4119-9a8d-b97e0706da08" status: 202 len: 0 microversion: 2.20 time: 0.576701 Aug 08 02:42:41.897467 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 458/918] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Aug 8 02:42:41 2022] DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-volume_attachments/8105c5b0-897e-4119-9a8d-b97e0706da08 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:42:41.960821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:41.961425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:41.967498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:41.967984 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:41.968422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:41.969115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:41.969577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:41.970005 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:42.000588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124658) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 02:42:42.016449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:42.024395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-feb2e257-368d-42b8-bffa-3a0893713482 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1549 microversion: 2.1 time: 0.159178 Aug 08 02:42:42.024956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 461/919] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:41 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:42.044674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:42.045238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:42.051044 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:42.051539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:42.051981 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:42.052700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:42.053791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:42.054225 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:42.132536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b54e5bd5-f6b3-46e3-a39b-a945265a735e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091439 Aug 08 02:42:42.133132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 462/920] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:42:42 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:42.235949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-50e2eaf7-3bd2-4b3b-ac27-ad51ecfb2b61 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "POST /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/action" status: 202 len: 0 microversion: 2.20 time: 0.279329 Aug 08 02:42:42.242943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 459/921] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 02:42:41 2022] POST /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:42:42.245497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:42.246216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:42.252667 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:42.253270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:42.253836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:42.254673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:42.255436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:42.255995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:42.502051 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:42.510811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:42.513618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:42.515015 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-514f25f4-8eb6-41ec-91ac-e05dc6b9f95e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1671 microversion: 2.20 time: 0.274102 Aug 08 02:42:42.515565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 463/922] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:42 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:43.194777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-e95b92c4-ef19-4603-b9db-17fa458d3fb1 req-e2a35a45-a5f1-4d59-be4d-8ce665b3fe8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2da221-88bf-462d-937d-649c2a8e611a", "tag": "0a4c4aaf-6038-4884-b9e4-69e81091d8c2"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:43.204494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e95b92c4-ef19-4603-b9db-17fa458d3fb1 req-e2a35a45-a5f1-4d59-be4d-8ce665b3fe8a service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.204973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e95b92c4-ef19-4603-b9db-17fa458d3fb1 req-e2a35a45-a5f1-4d59-be4d-8ce665b3fe8a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.205405 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e95b92c4-ef19-4603-b9db-17fa458d3fb1 req-e2a35a45-a5f1-4d59-be4d-8ce665b3fe8a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.217438 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-e95b92c4-ef19-4603-b9db-17fa458d3fb1 req-e2a35a45-a5f1-4d59-be4d-8ce665b3fe8a service nova] Creating event network-changed:0a4c4aaf-6038-4884-b9e4-69e81091d8c2 for instance 1e2da221-88bf-462d-937d-649c2a8e611a on hv-cinder-85226 Aug 08 02:42:43.222505 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-e95b92c4-ef19-4603-b9db-17fa458d3fb1 req-e2a35a45-a5f1-4d59-be4d-8ce665b3fe8a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032470 Aug 08 02:42:43.223101 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 460/923] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:42:43.539361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:43.540136 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:43.546598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.547081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.547695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.548397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.548849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.549815 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.684110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:43.692219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:43.694394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:43.695566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-750ae8b5-d71c-4ed7-bb90-d55f0557afb7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1671 microversion: 2.20 time: 0.160418 Aug 08 02:42:43.696130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 464/924] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:43 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:44.719344 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:44.720147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:44.726926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:44.727416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:44.727852 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:44.728544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:44.729001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:44.729429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:44.861199 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:44.869802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:44.871909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:44.872543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1c0ee0bf-4c25-4269-94c0-31742963752d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1673 microversion: 2.20 time: 0.157935 Aug 08 02:42:44.873114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 461/925] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:44 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:45.500888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:45.501401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:45.502996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-43980d8b-6947-49a3-9653-decd79044fad req-06e6b437-5327-4a45-ab0a-1d5198ced64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:45.508953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.509439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.509872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.510626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.511276 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.511700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.515882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-43980d8b-6947-49a3-9653-decd79044fad req-06e6b437-5327-4a45-ab0a-1d5198ced64d service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.516442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-43980d8b-6947-49a3-9653-decd79044fad req-06e6b437-5327-4a45-ab0a-1d5198ced64d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.516973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-43980d8b-6947-49a3-9653-decd79044fad req-06e6b437-5327-4a45-ab0a-1d5198ced64d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.532447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-43980d8b-6947-49a3-9653-decd79044fad req-06e6b437-5327-4a45-ab0a-1d5198ced64d service nova] Creating event network-changed:2673af77-3e95-439c-83d1-409d6e88dcb5 for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 on hv-cinder-85226 Aug 08 02:42:45.537712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-43980d8b-6947-49a3-9653-decd79044fad req-06e6b437-5327-4a45-ab0a-1d5198ced64d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038497 Aug 08 02:42:45.538427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 462/926] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:42:45.538583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:42:45.830120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2d07f860-fec9-4422-a242-06bcb32f625d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 204 len: 0 microversion: 2.1 time: 0.332449 Aug 08 02:42:45.839022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 465/927] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:42:45 2022] DELETE /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:42:45.844193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:45.845468 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:45.853238 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.854024 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.854217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.855178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.855633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.856235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.897955 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:45.899304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:45.907581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.908360 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.909221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.910021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:45.910698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:45.911140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:46.013395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.021173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a117512a-f8b2-4cc8-9547-b868df4014d8 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.184369 Aug 08 02:42:46.031279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 463/928] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:45 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:46.065799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.074332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.075980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.077480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-12c13267-4aa1-4ed2-b61c-53af82bc683d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.184222 Aug 08 02:42:46.078145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 466/929] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:45 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:47.045230 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:47.045839 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:47.052284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.052760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.053453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.054235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.054715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.055140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.104234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:47.104872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:47.111364 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.111836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.112265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.112953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.113399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.113825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.197909 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.205778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-87eed612-54de-480c-8ced-96dff6068b30 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.164429 Aug 08 02:42:47.206346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 464/930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:47 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:47.257897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.266880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.268434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.269641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cf5d6609-718c-4490-8c91-c6ee66694029 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.170197 Aug 08 02:42:47.270222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 467/931] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:47 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:48.228693 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:48.229303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:48.236148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:48.236639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:48.237077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:48.237785 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:48.238242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:48.238695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:48.293825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:48.294449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:48.301100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:48.301585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:48.302052 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:48.303453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:48.304108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:48.304537 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:48.456675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:48.472435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:48.473969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:48.476370 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c3cfe3c0-6f8a-482b-8e21-7c3f498cbeee tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.186609 Aug 08 02:42:48.476935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 468/932] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:48 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:48.675828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:48.684018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d4e628ca-e8cd-4125-975f-6cf0fceb1976 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1567 microversion: 2.1 time: 0.459945 Aug 08 02:42:48.684603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 465/933] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:48 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1567 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:49.023308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-67e3edfa-459b-4250-9dd3-39d104cf1ce6 req-ec17eccb-e642-45c0-9368-7a8ad4ef207c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83", "name": "network-vif-deleted", "tag": "2673af77-3e95-439c-83d1-409d6e88dcb5"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:49.032688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-67e3edfa-459b-4250-9dd3-39d104cf1ce6 req-ec17eccb-e642-45c0-9368-7a8ad4ef207c service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:49.033157 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-67e3edfa-459b-4250-9dd3-39d104cf1ce6 req-ec17eccb-e642-45c0-9368-7a8ad4ef207c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:49.033587 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-67e3edfa-459b-4250-9dd3-39d104cf1ce6 req-ec17eccb-e642-45c0-9368-7a8ad4ef207c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:49.046391 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-67e3edfa-459b-4250-9dd3-39d104cf1ce6 req-ec17eccb-e642-45c0-9368-7a8ad4ef207c service nova] Creating event network-vif-deleted:2673af77-3e95-439c-83d1-409d6e88dcb5 for instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 on hv-cinder-85226 Aug 08 02:42:49.049479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-67e3edfa-459b-4250-9dd3-39d104cf1ce6 req-ec17eccb-e642-45c0-9368-7a8ad4ef207c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 Aug 08 02:42:49.050052 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 469/934] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:49.500597 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:49.501133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:49.508358 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:49.508847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:49.509284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:49.510028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:49.510472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:49.510898 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:49.656942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:49.666128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:49.668083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:49.669613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e9679ff0-6632-447c-acc2-64b0b5935fd7 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.173287 Aug 08 02:42:49.670667 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 466/935] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:49 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:49.709054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:49.710550 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:49.719415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:49.720141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:49.720840 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:49.721704 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:49.722597 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:49.728573 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:49.836722 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:49.845318 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9e2b9e93-6f32-4c1d-a738-1cd3bb0ee5c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1218 microversion: 2.1 time: 0.142359 Aug 08 02:42:49.846156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 470/936] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:49 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:50.693163 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:50.694970 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:50.702117 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.702791 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.703234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.703951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.704403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.704829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.848318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:50.858132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:50.859685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:50.860967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7a582941-ba5f-46ae-8d20-f99dede4f4cd tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.171743 Aug 08 02:42:50.861711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 467/937] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:50 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:50.867791 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:50.868457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:50.875423 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.878476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.878476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.878476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.878476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.878859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.903946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:50.917413 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.917908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.918702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.919408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:50.969580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:50.978281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0b9575c9-b144-41bd-a1f7-259ce9202b96 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.114624 Aug 08 02:42:50.978970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 471/938] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:50 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:51.886178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:51.887859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:51.895173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:51.896075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:51.897190 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:51.898070 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:51.898742 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:51.899384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:52.002186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:52.003628 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:52.016744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:52.017235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:52.017676 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:52.022237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:52.024437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:52.026060 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:52.066511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:52.067435 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:52.068151 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:52.069526 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:52.140125 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:52.147181 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:52.151067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f83c4412-4fc0-45bc-a2a2-bf1cbd45e15d tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.153689 Aug 08 02:42:52.152152 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 472/939] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:51 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:52.156127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:52.157634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:52.158956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cb1a2ac8-bf4a-41f6-ae36-564f7341da94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.278564 Aug 08 02:42:52.161138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 468/940] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:51 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:53.172361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:53.173626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:53.183179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:53.183786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:53.194718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:53.195026 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:53.195528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:53.196290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:53.196755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:53.197192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:53.200707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:53.201194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:53.201882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:53.202609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:53.203236 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:53.203927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:53.268646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:53.269500 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:53.269969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:53.270619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:53.319837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:53.328445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e44beb03-8d15-467f-9404-61777bf4f589 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.159896 Aug 08 02:42:53.329655 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 473/941] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:53 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:53.419286 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:53.422154 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:53.431021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:53.433292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:53.434821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1580ccc6-b8ad-4e8d-86bb-701ba220fb48 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.255487 Aug 08 02:42:53.435966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 469/942] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:53 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:54.353119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:54.353787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:54.360451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:54.360937 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:54.361378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:54.362087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:54.362577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:54.363012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:54.397072 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:54.397702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:54.398152 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:54.398636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:54.459049 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:54.459769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:54.465944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:54.466749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:54.467399 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:54.468367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:54.468995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:54.469575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:54.474248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:54.489087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-19d7aaa7-e838-4058-a50a-1e86f9fb7963 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.141437 Aug 08 02:42:54.489667 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 474/943] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:54 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:54.676838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:54.686687 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:54.688281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:54.689894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-887036fa-8391-4ab1-a37a-afce465e498b tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.235905 Aug 08 02:42:54.690705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 470/944] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:54 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:55.511991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:55.513298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:55.520577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:55.521071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:55.521645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:55.523286 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:55.523830 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:55.524324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:55.557225 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:55.558114 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:55.558812 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:55.559439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:55.606726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:55.618950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-41b76438-5fe2-46b8-b803-d9e69dd80d43 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.107502 Aug 08 02:42:55.618950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 475/945] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:55 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:55.713320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:55.713930 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:55.716491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:55.728956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:55.729438 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:55.729900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:55.730646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:55.731103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:55.731527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:55.873566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:55.882089 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:55.883729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:55.884879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-85c284ae-0fcb-4942-af27-eb0644d7b676 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.175725 Aug 08 02:42:55.885495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 471/946] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:55 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:56.637748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:56.638528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:56.640984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:56.646243 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:56.647653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:56.648209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:56.652651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:56.652651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:56.652651 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:56.684613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:56.685485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:56.685978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:56.686474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:56.735183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:56.745635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d67172e-6756-4ac0-906a-f2405f177490 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.112229 Aug 08 02:42:56.747894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 476/947] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:56 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:56.909711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:56.910673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:56.918589 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:56.919236 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:56.920270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:56.921318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:56.922242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:56.922777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:57.081967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:57.091407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:57.092908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:57.094075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0a8fc093-8fc2-42b5-b1c2-b870b0720d8d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.188814 Aug 08 02:42:57.094678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 472/948] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:56 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:57.780933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:57.781580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:57.788473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:57.788970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:57.789409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:57.790113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:57.790599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:57.791033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:57.823890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:57.824352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:57.824794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:57.825251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:57.871459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:57.879401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9fe409d3-d53e-41cd-9c77-6d99c07abd70 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.103707 Aug 08 02:42:57.879967 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 477/949] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:57 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:58.118480 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:58.119151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:58.125367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:58.125845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:58.126273 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:58.127033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:58.127481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:58.127897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:58.259838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:58.267877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:58.269378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:58.270571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-10603e62-f39e-4cdd-854f-a116e4ce4a7d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.157020 Aug 08 02:42:58.271113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 473/950] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:58 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:42:58.901492 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:58.902171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:58.908531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:58.909011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:58.909440 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:58.910134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:58.910620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:58.911247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:58.941717 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:58.942206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:58.942660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:58.943100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:58.985169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:58.996859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5035bbf4-b712-4dd9-9d54-7f51308ee114 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.096239 Aug 08 02:42:58.996859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 478/951] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:42:58 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:42:59.293549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:59.294162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:59.300570 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:59.301060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:59.301521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:59.302206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:59.302739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:59.304472 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:59.435891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:59.443867 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:59.445354 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:59.446527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-80724f93-1090-44ce-84ee-08cccae7ae9e tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.156854 Aug 08 02:42:59.447080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 474/952] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:59 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:00.015982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.016527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:00.023560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:00.024038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:00.024474 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:00.025164 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:00.025618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:00.026043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:00.058373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:00.058856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:00.059290 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:00.059729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:43:00.099917 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:00.108620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-90e0e34c-e9ae-4c55-9fad-7720ee99a3dc tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.096634 Aug 08 02:43:00.109184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 479/953] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:00.469741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.470383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:00.477566 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:00.478206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:00.478824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:00.479486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:00.480020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:00.480558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:00.618252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:00.626481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:00.627994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:00.629156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-78a3a5aa-ab48-4252-bb29-e77ae49b0d0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.163474 Aug 08 02:43:00.629727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 475/954] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:01.128425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:01.128963 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:01.135499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:01.135973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:01.136402 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:01.137082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:01.137535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:01.137955 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:01.167732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:01.168203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:01.168631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:01.169069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:43:01.209204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:01.217140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b5702016-8cdf-44fe-bf63-fb19b4854f41 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.092602 Aug 08 02:43:01.217694 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 480/955] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:43:01 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:01.653799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:01.654423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:01.660933 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:01.666453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:01.666453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:01.666453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:01.666453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:01.666848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:01.799388 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:01.807773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:01.809340 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:01.810533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9747dc5b-a6a0-4899-9285-ff64fdbdb58a tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.160669 Aug 08 02:43:01.811094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 476/956] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:01 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:02.237828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:02.238392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:02.245566 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:02.246039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:02.246527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:02.247220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:02.247669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:02.248091 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:02.282045 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:02.282555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:02.282984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:02.284365 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:43:02.333141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:02.340733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8a1f0b6e-9bc8-4153-9df7-00074fe49d4f tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.106953 Aug 08 02:43:02.341300 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 481/957] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:43:02 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:02.833156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:02.833766 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:02.841373 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:02.841931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:02.842578 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:02.843363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:02.843816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:02.844239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:02.982626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:02.990575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:02.992103 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:02.993301 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5cb4ec7f-1209-4514-9cef-ce79b87bd1ad tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.164148 Aug 08 02:43:02.993859 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 477/958] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:02 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:03.362203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:03.362764 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:03.369374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:03.369848 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:03.370282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:03.370986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:03.371434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:03.371854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:03.404675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:03.405150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:03.405585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:03.406031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lazy-loading 'fault' on Instance uuid 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:43:03.446902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe07f55f4d54059a193d4611e0a4f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e069855c07d94296a331d49a7a2a7ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:03.454774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ba77d6f-b0ff-46c7-8115-0831087f5fa3 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 200 len: 1223 microversion: 2.1 time: 0.096432 Aug 08 02:43:03.455334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 482/959] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:43:03 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:04.015273 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:04.015906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:04.022191 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:04.022697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:04.023129 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:04.024473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:04.024925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:04.025345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:04.159678 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:04.168512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:04.170119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:04.171442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6e06cb92-eb9d-4cb7-ba28-da203b951165 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.160107 Aug 08 02:43:04.171936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 478/960] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:04 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:04.477071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:04.477862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] [instance: 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:04.484409 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:04.484976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:04.485321 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:04.486236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:04.486804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:04.487239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:04.502817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] HTTP exception thrown: Instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 could not be found. Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Request method failure captured: Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 HTTP/1.1 Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HZ6gJMe7rYPBB5cM-RlPH8JNgMySy3SgirfLMu9YxIkkpnI_y5OI6V89pUrW6g0UatTO-Cva_HWMlM8lKGXVu6HAFdDA76sMJoETDI83C6l9Fk3rITPkZoPkItW8ao0-xeTNtSRvSl8UJe9hKuHMWPja8nfCC6FpsDD0oLlcAe3qJE Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: e069855c07d94296a331d49a7a2a7ce4 Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestShelveInstance-1652796621 Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:43:04.504670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e069855c07d94296a331d49a7a2a7ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e069855c07d94296a331d49a7a2a7ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e069855c07d94296a331d49a7a2a7ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e069855c07d94296a331d49a7a2a7ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestShelveInstance-1652796621 Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e069855c07d94296a331d49a7a2a7ce4 Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestShelveInstance-1652796621 Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-TestShelveInstance-1652796621-project Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 0fe07f55f4d54059a193d4611e0a4f92 Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestShelveInstance-1652796621-project Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 could not be found. Aug 08 02:43:04.506387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83'} Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 could not be found. Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:43:04.507320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 could not be found. Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 could not be found. Aug 08 02:43:04.509568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:43:04.511145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Returning 404 to user: Instance 5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:43:04.511145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b9ff02e7-14d3-46af-b008-e9ab9b3da1c4 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83" status: 404 len: 111 microversion: 2.1 time: 0.034838 Aug 08 02:43:04.511145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 483/961] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:43:04 2022] GET /compute/v2.1/servers/5e45ddf3-c11d-43ce-b0d1-c06ce1fe0d83 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:43:04.736427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5f29bbe3-006f-438e-b849-35ae1689eed5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] Calling method '.version_select at 0x7fb2ba129040>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:04.835148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5f29bbe3-006f-438e-b849-35ae1689eed5 tempest-TestShelveInstance-1652796621 tempest-TestShelveInstance-1652796621-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-459619722" status: 202 len: 0 microversion: 2.1 time: 0.102635 Aug 08 02:43:04.835755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 479/962] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-459619722 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:43:05.194049 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:05.194689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:05.202111 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:05.202630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:05.203074 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:05.203879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:05.204219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:05.204647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:05.335798 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:05.339316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:05.344230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:05.345748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:05.346944 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6148f351-fe2c-48b7-8652-0c3fa4f70708 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.156807 Aug 08 02:43:05.347496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 484/963] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:05 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:43:05.908559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-293c8bde-675c-4c03-b358-630bd2e1dced req-c994c213-f09b-457b-b969-e657988f0abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "name": "network-vif-plugged", "status": "completed", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:43:05.923514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-293c8bde-675c-4c03-b358-630bd2e1dced req-c994c213-f09b-457b-b969-e657988f0abe service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:05.930699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-293c8bde-675c-4c03-b358-630bd2e1dced req-c994c213-f09b-457b-b969-e657988f0abe service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:05.930699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-293c8bde-675c-4c03-b358-630bd2e1dced req-c994c213-f09b-457b-b969-e657988f0abe service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:05.936157 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-293c8bde-675c-4c03-b358-630bd2e1dced req-c994c213-f09b-457b-b969-e657988f0abe service nova] Creating event network-vif-plugged:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:43:05.941603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-293c8bde-675c-4c03-b358-630bd2e1dced req-c994c213-f09b-457b-b969-e657988f0abe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038830 Aug 08 02:43:05.942216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 480/964] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:43:06.369405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:06.370061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:06.377427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:06.377982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:06.378536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:06.379327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:06.379845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:06.380340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:06.515148 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:06.523319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:06.525433 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:06.526753 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6527089e-c7ef-4993-ae1f-420622840430 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.161519 Aug 08 02:43:06.527311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 485/965] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:06 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:43:07.549690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:07.551017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:07.557956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:07.558598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:07.559225 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:07.559937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:07.560393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:07.560817 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:07.734829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:07.743244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:07.744851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:07.746001 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f9a39797-da6e-42b6-91e0-9a96988e0ef5 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.200633 Aug 08 02:43:07.746600 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 481/966] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:07 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:08.769719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:08.771047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:08.784202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:08.784612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:08.785055 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:08.785778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:08.786229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:08.787137 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:09.095988 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:09.105685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:09.107278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:09.108466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e2d5aedf-d6f8-4bbc-9343-49e2a59547a0 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1729 microversion: 2.20 time: 0.343174 Aug 08 02:43:09.109025 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 486/967] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:08 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1729 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:10.131485 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:10.132142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:10.139289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:10.139827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:10.140271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:10.140970 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:10.141431 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:10.141860 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:10.353435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:10.361490 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:10.363083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:43:10.364281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a66f93bc-c011-4d07-823b-650be6e0fc63 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1716 microversion: 2.20 time: 0.236943 Aug 08 02:43:10.369193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 482/968] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:43:10 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1716 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:43:41.438083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:43:41.438727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 02:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:43:58.456637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:58.457343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:43:58.459523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=35 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:58.460234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=12 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:58.464919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:58.465450 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:58.465880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:58.467575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:43:58.468046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:43:58.468476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:43:58.492232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-278bfba2-d716-440b-9ce5-e077cdbedfe6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/ips" status: 200 len: 147 microversion: 2.1 time: 0.039604 Aug 08 02:43:58.492800 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 487/969] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:43:58 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:01.115234 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3aa7272-53db-4f28-95c4-bab3d0cfdd88"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:01.117767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:01.119982 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:01.120661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=69 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:01.125750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:01.130945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:01.130945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:01.130945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:01.130945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:01.131318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:01.831185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-023d98a7-fcd7-4c3b-897d-0986fe48e85b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719989 Aug 08 02:44:01.831802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 483/970] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:44:01 2022] POST /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:06.706261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:06.708517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:06.715464 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:06.715943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:06.716382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:06.717074 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:06.718175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:06.718630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:06.745959 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3eec98b6-4229-42a4-9ed3-d8b088db1809 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044708 Aug 08 02:44:06.746523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 488/971] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 02:44:06 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:06.808943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:06.809530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:06.816258 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:06.816746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:06.817183 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:06.817875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:06.818332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:06.818781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:06.846201 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:44:07.080148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b06615ff-35e8-4bb3-8fdd-0eca19a0fa94 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 204 len: 0 microversion: 2.20 time: 0.275180 Aug 08 02:44:07.081123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 484/972] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 02:44:06 2022] DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 02:44:07.091223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:07.091855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:07.098067 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:07.098583 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:07.099060 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:07.099754 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:07.100211 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:07.100706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:07.228216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:07.236184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:07.237690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:07.238875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-27dee70d-8810-4411-a850-637085a1ffcb tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.151584 Aug 08 02:44:07.239428 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 489/973] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:07 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:44:08.261453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:08.262156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:08.269119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:08.269598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:08.270073 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:08.270786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:08.271241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:08.271664 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:08.400710 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:08.409419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:08.410944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:08.412078 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-56e68d5a-b768-4cab-8592-c0b4f5fa32da tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.154879 Aug 08 02:44:08.412637 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 485/974] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:08 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:44:09.436255 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:09.436857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:09.442899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:09.443374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:09.443806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:09.444487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:09.444933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:09.445354 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:09.578573 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:09.586454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:09.587961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:09.589150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4dee7974-4460-4ad1-8c63-49470a61f532 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1722 microversion: 2.20 time: 0.157209 Aug 08 02:44:09.589700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 490/975] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:09 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:44:10.406248 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:10.408709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:10.415295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.415784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.416224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.416992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.417455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.417884 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.452297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-135e7915-230f-4a20-b876-8b8ef98f288b tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050240 Aug 08 02:44:10.453302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 486/976] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:44:10 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:10.463789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:10.464555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:10.471322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.471878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.472439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.473159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.473672 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.474161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.512837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e26717fd-c050-4afe-9188-daf4b9b8fa65 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/f3aa7272-53db-4f28-95c4-bab3d0cfdd88" status: 200 len: 194 microversion: 2.1 time: 0.053296 Aug 08 02:44:10.513636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 491/977] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 8 02:44:10 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/f3aa7272-53db-4f28-95c4-bab3d0cfdd88 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:10.614916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:10.615735 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:10.631129 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.638799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.638799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.638799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.638799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.639708 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.781588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:10.796465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:10.798857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fd9eb21aa634650a7022b7b4ca145fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddb64c31c0a4db2a184543c435c7bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:10.800131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3d04eb5d-7ed8-4898-8a12-d966da08d58c tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 200 len: 1654 microversion: 2.20 time: 0.191200 Aug 08 02:44:10.801207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 492/978] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:10 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:44:10.917496 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-455e3676-d545-4586-a30b-109b1e7b6848 req-3f3fb695-f8d6-4dd9-b0b3-2c2d19d375be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af55837-b03e-4343-9650-3adfa1bdceec", "name": "network-vif-deleted", "tag": "c3df9322-b3ad-432a-8a54-5417ca654fb3"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:10.928050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-455e3676-d545-4586-a30b-109b1e7b6848 req-3f3fb695-f8d6-4dd9-b0b3-2c2d19d375be service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.928526 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-455e3676-d545-4586-a30b-109b1e7b6848 req-3f3fb695-f8d6-4dd9-b0b3-2c2d19d375be service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.928948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-455e3676-d545-4586-a30b-109b1e7b6848 req-3f3fb695-f8d6-4dd9-b0b3-2c2d19d375be service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.940252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-455e3676-d545-4586-a30b-109b1e7b6848 req-3f3fb695-f8d6-4dd9-b0b3-2c2d19d375be service nova] Creating event network-vif-deleted:c3df9322-b3ad-432a-8a54-5417ca654fb3 for instance 9af55837-b03e-4343-9650-3adfa1bdceec on hv-cinder-85226 Aug 08 02:44:10.946594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-455e3676-d545-4586-a30b-109b1e7b6848 req-3f3fb695-f8d6-4dd9-b0b3-2c2d19d375be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449756 Aug 08 02:44:10.946594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 487/979] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:11.823548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:11.824153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:11.831814 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:11.832289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:11.832731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:11.833404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:11.833852 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:11.834270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:11.848511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] HTTP exception thrown: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Request method failure captured: Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec HTTP/1.1 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW130sMqltG59_Bk4ZAu1m5FL58nAPZCfaVZwE9GJY_VQiCD8H9H6MR82CalBegP5Suk820exj3LlqVBa8fLepKmuJaL_GYtU522PwqElRK_tIx2Hl8dC10tVj7iLU47rCG5NVFARulcTNTzmyxfpnD865gKCZTPVR2d6I66-8HV2E Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:11.850082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 7fd9eb21aa634650a7022b7b4ca145fd Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:11.857709 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '9af55837-b03e-4343-9650-3adfa1bdceec'} Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:11.858744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:11.860304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:11.861674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Returning 404 to user: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:11.861674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-98017c22-20ae-4a75-a8ed-41c2ea40b33d tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 404 len: 111 microversion: 2.20 time: 0.031851 Aug 08 02:44:11.861674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 493/980] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:11 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:44:11.861934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-929195e2-6b9d-4806-9dad-5de86a91ce0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '.version_select at 0x7fb2ba04b820>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:11.925699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-929195e2-6b9d-4806-9dad-5de86a91ce0f tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38010807" status: 204 len: 0 microversion: 2.20 time: 0.068866 Aug 08 02:44:11.926287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 488/981] 10.222.0.15 () {60 vars in 1256 bytes} [Mon Aug 8 02:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38010807 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 02:44:13.257630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14024f4a-ab78-4fee-a5cc-703ea2ff722f"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:13.260033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:13.266931 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.271166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.271166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.271166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.271166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.271591 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.836463 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5c1b5f09-0ba5-4e56-9e01-9bfce43b5191 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "POST /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582638 Aug 08 02:44:13.837066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 494/982] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:44:13 2022] POST /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:13.947300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:13.947912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:13.955414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.955948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.956397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.957188 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.957507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.957929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.971455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] HTTP exception thrown: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Request method failure captured: Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec HTTP/1.1 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW130sMqltG59_Bk4ZAu1m5FL58nAPZCfaVZwE9GJY_VQiCD8H9H6MR82CalBegP5Suk820exj3LlqVBa8fLepKmuJaL_GYtU522PwqElRK_tIx2Hl8dC10tVj7iLU47rCG5NVFARulcTNTzmyxfpnD865gKCZTPVR2d6I66-8HV2E Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:44:13.973180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 7fd9eb21aa634650a7022b7b4ca145fd Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:13.974830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '9af55837-b03e-4343-9650-3adfa1bdceec'} Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:13.975700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:13.977153 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:13.978641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Returning 404 to user: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:13.978641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-499ab55b-f187-42be-989e-42fb3b3d9925 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 404 len: 111 microversion: 2.20 time: 0.031653 Aug 08 02:44:13.978641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 489/983] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 02:44:13 2022] DELETE /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:44:13.984490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:13.985064 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 9af55837-b03e-4343-9650-3adfa1bdceec] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:13.991589 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.992076 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.992517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.993225 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.993676 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.994106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:14.008890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] HTTP exception thrown: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Request method failure captured: Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec HTTP/1.1 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW130sMqltG59_Bk4ZAu1m5FL58nAPZCfaVZwE9GJY_VQiCD8H9H6MR82CalBegP5Suk820exj3LlqVBa8fLepKmuJaL_GYtU522PwqElRK_tIx2Hl8dC10tVj7iLU47rCG5NVFARulcTNTzmyxfpnD865gKCZTPVR2d6I66-8HV2E Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:14.010165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 7fd9eb21aa634650a7022b7b4ca145fd Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:14.011934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '9af55837-b03e-4343-9650-3adfa1bdceec'} Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:14.012811 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. Aug 08 02:44:14.015332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:14.016682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Returning 404 to user: Instance 9af55837-b03e-4343-9650-3adfa1bdceec could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:14.016682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ecd5d312-5420-4830-9229-9e84373a52bc tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec" status: 404 len: 111 microversion: 2.20 time: 0.032166 Aug 08 02:44:14.016682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 495/984] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:13 2022] GET /compute/v2.1/servers/9af55837-b03e-4343-9650-3adfa1bdceec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:44:15.248036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:15.249690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:15.255475 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:15.255958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:15.256396 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:15.257087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:15.257547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:15.257973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:15.271232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] HTTP exception thrown: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Request method failure captured: Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a HTTP/1.1 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HW130sMqltG59_Bk4ZAu1m5FL58nAPZCfaVZwE9GJY_VQiCD8H9H6MR82CalBegP5Suk820exj3LlqVBa8fLepKmuJaL_GYtU522PwqElRK_tIx2Hl8dC10tVj7iLU47rCG5NVFARulcTNTzmyxfpnD865gKCZTPVR2d6I66-8HV2E Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:44:15.272797 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 7fd9eb21aa634650a7022b7b4ca145fd Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.274524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '406d6f4e-a119-4be3-82c0-61f8de65229a'} Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:15.275443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.276947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.278464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Returning 404 to user: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:15.278464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-473ddf08-7cb3-4ac8-a759-9a3063de3199 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 404 len: 111 microversion: 2.20 time: 0.030027 Aug 08 02:44:15.278464 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 490/985] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 02:44:15 2022] DELETE /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:44:15.283390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:15.284035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] [instance: 406d6f4e-a119-4be3-82c0-61f8de65229a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:15.290427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:15.290914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:15.291356 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:15.292052 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:15.292511 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:15.292943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:15.308487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] HTTP exception thrown: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Request method failure captured: Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a HTTP/1.1 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HW130sMqltG59_Bk4ZAu1m5FL58nAPZCfaVZwE9GJY_VQiCD8H9H6MR82CalBegP5Suk820exj3LlqVBa8fLepKmuJaL_GYtU522PwqElRK_tIx2Hl8dC10tVj7iLU47rCG5NVFARulcTNTzmyxfpnD865gKCZTPVR2d6I66-8HV2E Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:15.310105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dddb64c31c0a4db2a184543c435c7bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: dddb64c31c0a4db2a184543c435c7bc0 Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1093534834 Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 7fd9eb21aa634650a7022b7b4ca145fd Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1093534834-project Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.311987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '406d6f4e-a119-4be3-82c0-61f8de65229a'} Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:15.312775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. Aug 08 02:44:15.314059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:15.315198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] Returning 404 to user: Instance 406d6f4e-a119-4be3-82c0-61f8de65229a could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:15.315198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2cdeb8aa-28f5-4cd0-a795-38efae87d300 tempest-AttachVolumeShelveTestJSON-1093534834 tempest-AttachVolumeShelveTestJSON-1093534834-project] 10.222.0.15 "GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a" status: 404 len: 111 microversion: 2.20 time: 0.032868 Aug 08 02:44:15.315198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 496/986] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 02:44:15 2022] GET /compute/v2.1/servers/406d6f4e-a119-4be3-82c0-61f8de65229a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 02:44:20.897430 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6e4ee8ea-a521-441b-ba2e-413dc2c3d474 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Action: 'create', calling method: .version_select at 0x7fb2ba25aee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-307385327"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:21.377997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:21.380689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:21.387335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.387806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.388238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.389461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.389919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.390449 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.419596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bfca3e57-6c03-42ea-b561-419bb0d39266 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045446 Aug 08 02:44:21.420287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 497/987] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:44:21 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:21.490334 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6e4ee8ea-a521-441b-ba2e-413dc2c3d474 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.711687 Aug 08 02:44:21.490990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 491/988] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Aug 8 02:44:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 713 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 02:44:21.503619 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aef12a76-e0dd-4ae8-b39b-96b4f1c0af6e tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba1b7b80>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:21.554948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aef12a76-e0dd-4ae8-b39b-96b4f1c0af6e tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 200 len: 344 microversion: 2.1 time: 0.055028 Aug 08 02:44:21.555594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 498/989] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:44:21 2022] GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:21.564378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:21.564878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:21.571782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.572269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.572706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.573410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.573868 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.574294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.604403 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f1609d87-e5fd-4c4f-b248-22e4667c53f6 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/f3aa7272-53db-4f28-95c4-bab3d0cfdd88" status: 200 len: 194 microversion: 2.1 time: 0.044431 Aug 08 02:44:21.605002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 492/990] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 8 02:44:21 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/f3aa7272-53db-4f28-95c4-bab3d0cfdd88 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:21.615789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:21.616283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:21.622161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.625204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.625204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.625204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.625204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.625585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.706127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lazy-loading 'services' on Instance uuid 1e2da221-88bf-462d-937d-649c2a8e611a {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:44:21.917983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-599e2a71-7efe-42f8-b3b4-715456bde340 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/f3aa7272-53db-4f28-95c4-bab3d0cfdd88" status: 202 len: 0 microversion: 2.1 time: 0.305945 Aug 08 02:44:21.918839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 499/991] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:44:21 2022] DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/f3aa7272-53db-4f28-95c4-bab3d0cfdd88 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:44:22.579124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-63828827-4d07-4094-9060-d74688a6bfe0 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba23aee0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:22.616912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-63828827-4d07-4094-9060-d74688a6bfe0 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 200 len: 345 microversion: 2.1 time: 0.051178 Aug 08 02:44:22.617527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 493/992] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:44:22 2022] GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:22.630271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0f88ff22-ecc6-462e-8f2b-5b4bdcd220d3 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Action: 'create', calling method: .version_select at 0x7fb2bc126c10>, body: {"snapshot": {"volume_id": "e3bd6c02-7b04-444b-84da-3adf5297b997", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-164594100"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:23.113545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0f88ff22-ecc6-462e-8f2b-5b4bdcd220d3 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.487161 Aug 08 02:44:23.114209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 500/993] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Aug 8 02:44:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:23.134203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e1c94d47-660e-4232-86b3-38840984f1e7 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2b9fdbaf0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.146553 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.147035 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:23.157523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.157523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.157523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.157523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.157881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.157881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.160311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e1c94d47-660e-4232-86b3-38840984f1e7 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.038334 Aug 08 02:44:23.160879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 494/994] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:23.171819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8d856e33-f5f6-42e9-90af-32c9d380825a tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba04b700>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.187506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0b38ad58-e5b3-4187-9338-2af2e4256a81 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/14024f4a-ab78-4fee-a5cc-703ea2ff722f" status: 200 len: 194 microversion: 2.1 time: 0.045444 Aug 08 02:44:23.188958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 501/995] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/14024f4a-ab78-4fee-a5cc-703ea2ff722f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:23.198146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.198666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:23.206893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8d856e33-f5f6-42e9-90af-32c9d380825a tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039195 Aug 08 02:44:23.207109 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.207381 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 495/996] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:23.207732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.208182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.208981 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.209439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.209870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.220756 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-83574cf3-25f8-47db-8139-b5255c9e5592 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2b9ef0670>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.251908 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-83574cf3-25f8-47db-8139-b5255c9e5592 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.034829 Aug 08 02:44:23.252481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 496/997] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:23.296177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lazy-loading 'services' on Instance uuid 1e2da221-88bf-462d-937d-649c2a8e611a {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:44:23.552106 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-948af7f6-7279-4950-8997-fc3b8656c448 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/14024f4a-ab78-4fee-a5cc-703ea2ff722f" status: 202 len: 0 microversion: 2.1 time: 0.357612 Aug 08 02:44:23.552706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 502/998] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:44:23 2022] DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments/14024f4a-ab78-4fee-a5cc-703ea2ff722f => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:44:24.266537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fced1447-d319-4704-89ca-d27e56933a22 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba076820>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:24.297794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fced1447-d319-4704-89ca-d27e56933a22 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.037240 Aug 08 02:44:24.298412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 497/999] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:24 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:25.311998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1a2e3c04-233d-4f54-9a95-914d2ec023f9 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba2b7c10>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:25.341535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1a2e3c04-233d-4f54-9a95-914d2ec023f9 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.034838 Aug 08 02:44:25.342757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 503/1000] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:25 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:26.355262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b1ca1265-47ea-4bf0-9274-c84086d27922 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba1a0700>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:26.384893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b1ca1265-47ea-4bf0-9274-c84086d27922 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.034017 Aug 08 02:44:26.385448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 498/1001] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:26 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:27.398834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d361a6ed-6103-4450-981c-af75c05234bf tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba1b7b80>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:27.429182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d361a6ed-6103-4450-981c-af75c05234bf tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.034631 Aug 08 02:44:27.429746 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 504/1002] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:27 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:28.442899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d793e9c2-aee0-4fb2-9613-cea5c011bf02 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba00dee0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:28.472293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d793e9c2-aee0-4fb2-9613-cea5c011bf02 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 287 microversion: 2.1 time: 0.033634 Aug 08 02:44:28.472849 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 499/1003] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:28 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:28.485118 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bb1bd8e9-bc33-4c02-8e3d-fb12932f6415 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba1c8310>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:28.575807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bb1bd8e9-bc33-4c02-8e3d-fb12932f6415 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 202 len: 0 microversion: 2.1 time: 0.095398 Aug 08 02:44:28.576536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 505/1004] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Aug 8 02:44:28 2022] DELETE /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:44:28.584653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-62948087-f102-456f-b261-b090be67bca9 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba4a5ee0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:28.613910 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-62948087-f102-456f-b261-b090be67bca9 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 200 len: 286 microversion: 2.1 time: 0.033197 Aug 08 02:44:28.614499 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 500/1005] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:28 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:28.943822 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:28.946244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:28.952868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:28.953353 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:28.953793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:28.954535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:28.954991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:28.955421 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:28.985138 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a0e038a7-2bb2-46f1-aa4a-5228b0d9d343 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045172 Aug 08 02:44:28.985708 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 506/1006] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:44:28 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:44:29.098798 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.100930 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:29.107371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.107855 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.108293 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.108982 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.109438 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.109864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.137806 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8deb5060-76e7-489e-b84d-ea38c977b592 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043031 Aug 08 02:44:29.138428 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 501/1007] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:44:29 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:44:29.208871 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.209365 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:29.215310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.215789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.216230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.216920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.217376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.217803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.244154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:44:29.258238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:29.478071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c93c8811-2bd4-4f49-8948-87bb83fae974 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 204 len: 0 microversion: 2.1 time: 0.272703 Aug 08 02:44:29.478793 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 507/1008] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:44:29 2022] DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:44:29.486995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.487638 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:29.494226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.494731 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.501243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.501243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.501243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.501243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.628242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-338c20e2-abe8-461f-a63b-0f5159a5cf62 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba2b7a60>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.631471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:29.640110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5c100ba9-9415-4cfb-bfd1-515f1ff17284 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1674 microversion: 2.1 time: 0.157039 Aug 08 02:44:29.640683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 502/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:29 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:29.655848 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-338c20e2-abe8-461f-a63b-0f5159a5cf62 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] HTTP exception thrown: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-338c20e2-abe8-461f-a63b-0f5159a5cf62 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Request method failure captured: Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 HTTP/1.1 Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiEeN7DRMmpQCY1MwPjkQq2WWm2KFHTGeMsEzlFiZv1vaByaEGsx-llbcGYS0m9FnFxWmL4dBm9UvS-OyvT96_s2cf6MQdPMdw7xKvVYf-c78QPpum2H3ymSVcmmx5jZEhVTmCDNfoBFGr8XeAnNgLMs91vZuQj7JhM1YgoRFVwSCk Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:29.658213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 174fe89442b64ab0abadc7e2e5a9115a Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '1f60fa85-1587-4fac-8d0a-0ec6445d1dd4'} Aug 08 02:44:29.659864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. (HTTP 404) (Request-ID: req-21169d2b-5e8e-4dd1-825c-d9441f8804a3) Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.660901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:44:29.662281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 02:44:29.663670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-338c20e2-abe8-461f-a63b-0f5159a5cf62 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Returning 404 to user: Snapshot 1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:29.665182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-338c20e2-abe8-461f-a63b-0f5159a5cf62 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4" status: 404 len: 111 microversion: 2.1 time: 0.036893 Aug 08 02:44:29.666151 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 508/1010] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 02:44:29 2022] GET /compute/v2.1/os-snapshots/1f60fa85-1587-4fac-8d0a-0ec6445d1dd4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:44:29.668122 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6cbdb1ed-b144-45cd-a5c9-f922007f1ee3 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2b9fdb820>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.872214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6cbdb1ed-b144-45cd-a5c9-f922007f1ee3 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 202 len: 0 microversion: 2.1 time: 0.207698 Aug 08 02:44:29.872786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 503/1011] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:44:29 2022] DELETE /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:44:29.882140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f5c9de34-5608-4d5f-b7a6-ded4788a85f0 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba2751f0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.929717 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f5c9de34-5608-4d5f-b7a6-ded4788a85f0 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 200 len: 344 microversion: 2.1 time: 0.051250 Aug 08 02:44:29.930319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 509/1012] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:44:29 2022] GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:30.661964 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:30.662553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:30.668494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:30.670298 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:30.670298 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:30.670298 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:30.670646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:30.670906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:30.802503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:30.809829 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-73a48c76-45fa-4344-8ca9-5ba4fe31b34e tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1674 microversion: 2.1 time: 0.152207 Aug 08 02:44:30.810416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 504/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:30 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:30.944871 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cb76c9b7-fcf5-43c0-b321-54f7089e656b tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba2b73a0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:30.972855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-cb76c9b7-fcf5-43c0-b321-54f7089e656b tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] HTTP exception thrown: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cb76c9b7-fcf5-43c0-b321-54f7089e656b tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Request method failure captured: Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 HTTP/1.1 Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiEeN7DRMmpQCY1MwPjkQq2WWm2KFHTGeMsEzlFiZv1vaByaEGsx-llbcGYS0m9FnFxWmL4dBm9UvS-OyvT96_s2cf6MQdPMdw7xKvVYf-c78QPpum2H3ymSVcmmx5jZEhVTmCDNfoBFGr8XeAnNgLMs91vZuQj7JhM1YgoRFVwSCk Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:30.974807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 174fe89442b64ab0abadc7e2e5a9115a Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'e3bd6c02-7b04-444b-84da-3adf5297b997'} Aug 08 02:44:30.976374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. (HTTP 404) (Request-ID: req-bd4cbf08-f989-4174-8346-ac5e644a6baf) Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:30.977461 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:44:30.978966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:44:30.980209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cb76c9b7-fcf5-43c0-b321-54f7089e656b tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Returning 404 to user: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cb76c9b7-fcf5-43c0-b321-54f7089e656b tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 404 len: 109 microversion: 2.1 time: 0.035722 Aug 08 02:44:30.981443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 510/1014] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:44:30 2022] GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:30.990605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-11f07770-5bbb-4f41-9a91-86e77ba728ad tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba04b040>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:31.020588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-11f07770-5bbb-4f41-9a91-86e77ba728ad tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] HTTP exception thrown: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-11f07770-5bbb-4f41-9a91-86e77ba728ad tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Request method failure captured: Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: DELETE /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 HTTP/1.1 Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiEeN7DRMmpQCY1MwPjkQq2WWm2KFHTGeMsEzlFiZv1vaByaEGsx-llbcGYS0m9FnFxWmL4dBm9UvS-OyvT96_s2cf6MQdPMdw7xKvVYf-c78QPpum2H3ymSVcmmx5jZEhVTmCDNfoBFGr8XeAnNgLMs91vZuQj7JhM1YgoRFVwSCk Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:44:31.022599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 174fe89442b64ab0abadc7e2e5a9115a Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'e3bd6c02-7b04-444b-84da-3adf5297b997'} Aug 08 02:44:31.031002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. (HTTP 404) (Request-ID: req-320fa5da-e4c3-4175-bc10-4a4fddde9739) Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:31.031975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:44:31.033414 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 02:44:31.034816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-11f07770-5bbb-4f41-9a91-86e77ba728ad tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Returning 404 to user: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:31.036280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-11f07770-5bbb-4f41-9a91-86e77ba728ad tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 404 len: 109 microversion: 2.1 time: 0.037535 Aug 08 02:44:31.037247 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 505/1015] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:44:30 2022] DELETE /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:31.037335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00ec75d5-ace1-43bb-906e-6d8033523396 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Calling method '.version_select at 0x7fb2ba2755e0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:31.063324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-00ec75d5-ace1-43bb-906e-6d8033523396 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] HTTP exception thrown: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00ec75d5-ace1-43bb-906e-6d8033523396 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Request method failure captured: Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 HTTP/1.1 Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiEeN7DRMmpQCY1MwPjkQq2WWm2KFHTGeMsEzlFiZv1vaByaEGsx-llbcGYS0m9FnFxWmL4dBm9UvS-OyvT96_s2cf6MQdPMdw7xKvVYf-c78QPpum2H3ymSVcmmx5jZEhVTmCDNfoBFGr8XeAnNgLMs91vZuQj7JhM1YgoRFVwSCk Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:31.065975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/13640ce1c7ca4176978c4144862ff1ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 13640ce1c7ca4176978c4144862ff1ad Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1185139338 Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 174fe89442b64ab0abadc7e2e5a9115a Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1185139338-project Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'e3bd6c02-7b04-444b-84da-3adf5297b997'} Aug 08 02:44:31.067631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. (HTTP 404) (Request-ID: req-1ecdc50a-57b0-4b03-89fe-9e7154f7cfb0) Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:31.068611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:44:31.070043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:44:31.071604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00ec75d5-ace1-43bb-906e-6d8033523396 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] Returning 404 to user: Volume e3bd6c02-7b04-444b-84da-3adf5297b997 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-00ec75d5-ace1-43bb-906e-6d8033523396 tempest-VolumesSnapshotsTestJSON-1185139338 tempest-VolumesSnapshotsTestJSON-1185139338-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997" status: 404 len: 109 microversion: 2.1 time: 0.035375 Aug 08 02:44:31.073073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 511/1016] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 02:44:31 2022] GET /compute/v2.1/os-volumes/e3bd6c02-7b04-444b-84da-3adf5297b997 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:31.831465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:31.832126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:31.834943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:31.839571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:31.840055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:31.842555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:31.842555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:31.842555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:31.842555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:31.846869 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:32.125762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:32.134002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-efa6c48e-87a0-4acb-ba4a-5698d038eaf3 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1674 microversion: 2.1 time: 0.306863 Aug 08 02:44:32.134673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 506/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:31 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1674 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:32.623775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-a15983d6-be63-4fac-87d4-a0d404414997 req-1a5a1455-a9ef-4767-8680-2ce0014023e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2da221-88bf-462d-937d-649c2a8e611a", "name": "network-vif-deleted", "tag": "0a4c4aaf-6038-4884-b9e4-69e81091d8c2"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:32.638344 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a15983d6-be63-4fac-87d4-a0d404414997 req-1a5a1455-a9ef-4767-8680-2ce0014023e7 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:32.638918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a15983d6-be63-4fac-87d4-a0d404414997 req-1a5a1455-a9ef-4767-8680-2ce0014023e7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:32.639555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a15983d6-be63-4fac-87d4-a0d404414997 req-1a5a1455-a9ef-4767-8680-2ce0014023e7 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:32.654953 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-a15983d6-be63-4fac-87d4-a0d404414997 req-1a5a1455-a9ef-4767-8680-2ce0014023e7 service nova] Creating event network-vif-deleted:0a4c4aaf-6038-4884-b9e4-69e81091d8c2 for instance 1e2da221-88bf-462d-937d-649c2a8e611a on hv-cinder-85226 Aug 08 02:44:32.661905 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-a15983d6-be63-4fac-87d4-a0d404414997 req-1a5a1455-a9ef-4767-8680-2ce0014023e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043455 Aug 08 02:44:32.663883 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 512/1018] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:33.156053 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:33.157886 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:33.165531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.166115 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.166782 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.167697 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.168333 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.168938 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.208348 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.208944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.209450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.210006 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lazy-loading 'fault' on Instance uuid 1e2da221-88bf-462d-937d-649c2a8e611a {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:44:33.256569 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55afeedd651248da8ac80c61fb0729cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897030a5075b4ca3ad29d73371306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:33.264242 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-077fb5cd-c1cd-451c-919a-3524993c3006 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 200 len: 1326 microversion: 2.1 time: 0.111960 Aug 08 02:44:33.264807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 507/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:33 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:34.288189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:34.288913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:34.294966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:34.295448 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:34.295887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:34.296579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:34.297042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:34.297472 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:34.311458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] HTTP exception thrown: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Request method failure captured: Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a HTTP/1.1 Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HZpqzG9MJ5b3xPR1Tw-Jd1pREl-LmVgokPVon9k-Qu54bJ59GSD2xDa8eS98wRa1k7BKv4sMlDdTLENwRM64msbpwRMu95nJ_Jyg4s_PokH4pUZIIawpq9wsDsI3OKb9C1iO9A3NH7DHUlBbpO2eID6RmbkXhIx5k3Zzwg_jmnv6HU Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:34.313175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_897030a5075b4ca3ad29d73371306a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 55afeedd651248da8ac80c61fb0729cc Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:34.319371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '1e2da221-88bf-462d-937d-649c2a8e611a'} Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:34.320259 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:34.321799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:34.323154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Returning 404 to user: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:34.323154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8cc432d3-5300-4291-b85d-cef54a7d52db tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 404 len: 111 microversion: 2.1 time: 0.031750 Aug 08 02:44:34.323154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 513/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:34 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:34.324718 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9fe96fd3-2755-4ef0-afb3-1a6d23af1808 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '.version_select at 0x7fb2ba028ca0>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:34.382179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9fe96fd3-2755-4ef0-afb3-1a6d23af1808 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-844500154" status: 202 len: 0 microversion: 2.1 time: 0.061469 Aug 08 02:44:34.382814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 508/1021] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 02:44:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-844500154 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:44:37.819324 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:37.820357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:37.822901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:37.827732 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:37.828208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:37.828645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:37.830287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:37.830823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:37.831248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:37.850809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] HTTP exception thrown: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Request method failure captured: Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a HTTP/1.1 Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HZpqzG9MJ5b3xPR1Tw-Jd1pREl-LmVgokPVon9k-Qu54bJ59GSD2xDa8eS98wRa1k7BKv4sMlDdTLENwRM64msbpwRMu95nJ_Jyg4s_PokH4pUZIIawpq9wsDsI3OKb9C1iO9A3NH7DHUlBbpO2eID6RmbkXhIx5k3Zzwg_jmnv6HU Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:37.852634 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_897030a5075b4ca3ad29d73371306a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 55afeedd651248da8ac80c61fb0729cc Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.854197 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '1e2da221-88bf-462d-937d-649c2a8e611a'} Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:37.856875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.858269 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.859675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Returning 404 to user: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:37.859675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-34bcde1d-9f71-4783-a953-c642d4bb8c84 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 404 len: 111 microversion: 2.1 time: 0.038487 Aug 08 02:44:37.859675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 514/1022] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:44:37 2022] DELETE /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:37.864004 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:37.864615 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 1e2da221-88bf-462d-937d-649c2a8e611a] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:37.873462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:37.873976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:37.874591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:37.875283 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:37.875732 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:37.876688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:37.889749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] HTTP exception thrown: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Request method failure captured: Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a HTTP/1.1 Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HZpqzG9MJ5b3xPR1Tw-Jd1pREl-LmVgokPVon9k-Qu54bJ59GSD2xDa8eS98wRa1k7BKv4sMlDdTLENwRM64msbpwRMu95nJ_Jyg4s_PokH4pUZIIawpq9wsDsI3OKb9C1iO9A3NH7DHUlBbpO2eID6RmbkXhIx5k3Zzwg_jmnv6HU Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:44:37.891300 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_897030a5075b4ca3ad29d73371306a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 55afeedd651248da8ac80c61fb0729cc Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.893486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '1e2da221-88bf-462d-937d-649c2a8e611a'} Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:37.894335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. Aug 08 02:44:37.895894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:37.897168 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Returning 404 to user: Instance 1e2da221-88bf-462d-937d-649c2a8e611a could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:37.897168 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-32f63af3-061b-48fa-8110-75534f0353bc tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a" status: 404 len: 111 microversion: 2.1 time: 0.034339 Aug 08 02:44:37.897168 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 509/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:37 2022] GET /compute/v2.1/servers/1e2da221-88bf-462d-937d-649c2a8e611a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:39.171129 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:39.171625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:39.178671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:39.179095 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:39.179526 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:39.180207 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:39.180653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:39.181081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:39.195503 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] HTTP exception thrown: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Request method failure captured: Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 HTTP/1.1 Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HZpqzG9MJ5b3xPR1Tw-Jd1pREl-LmVgokPVon9k-Qu54bJ59GSD2xDa8eS98wRa1k7BKv4sMlDdTLENwRM64msbpwRMu95nJ_Jyg4s_PokH4pUZIIawpq9wsDsI3OKb9C1iO9A3NH7DHUlBbpO2eID6RmbkXhIx5k3Zzwg_jmnv6HU Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:44:39.197013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_897030a5075b4ca3ad29d73371306a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 55afeedd651248da8ac80c61fb0729cc Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.198608 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '06ed21ea-bc5e-4251-bcc7-fbfe640ab747'} Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:39.199899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.201342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.202899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Returning 404 to user: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:39.202899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1647559b-c680-4f07-8075-3fe1cd131a02 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 404 len: 111 microversion: 2.1 time: 0.031437 Aug 08 02:44:39.202899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 515/1024] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:44:39 2022] DELETE /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:39.208113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:39.208719 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] [instance: 06ed21ea-bc5e-4251-bcc7-fbfe640ab747] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:39.215046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:39.215519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:39.215947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:39.216627 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:39.217077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:39.217493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:39.231040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] HTTP exception thrown: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Request method failure captured: Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 HTTP/1.1 Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HZpqzG9MJ5b3xPR1Tw-Jd1pREl-LmVgokPVon9k-Qu54bJ59GSD2xDa8eS98wRa1k7BKv4sMlDdTLENwRM64msbpwRMu95nJ_Jyg4s_PokH4pUZIIawpq9wsDsI3OKb9C1iO9A3NH7DHUlBbpO2eID6RmbkXhIx5k3Zzwg_jmnv6HU Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:44:39.232531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_897030a5075b4ca3ad29d73371306a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/897030a5075b4ca3ad29d73371306a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 897030a5075b4ca3ad29d73371306a66 Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1218777070 Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 55afeedd651248da8ac80c61fb0729cc Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeTestJSON-1218777070-project Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.233973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '06ed21ea-bc5e-4251-bcc7-fbfe640ab747'} Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:44:39.234739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. Aug 08 02:44:39.236112 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:44:39.237395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] Returning 404 to user: Instance 06ed21ea-bc5e-4251-bcc7-fbfe640ab747 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:44:39.237395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cc9d2a71-90c4-4fab-b85d-32955e3918e1 tempest-AttachVolumeTestJSON-1218777070 tempest-AttachVolumeTestJSON-1218777070-project] 10.222.0.15 "GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747" status: 404 len: 111 microversion: 2.1 time: 0.030714 Aug 08 02:44:39.237395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 510/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:39 2022] GET /compute/v2.1/servers/06ed21ea-bc5e-4251-bcc7-fbfe640ab747 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:44:50.389849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:50.392542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:50.658436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08bf60e6-95e8-49c8-b862-f6fdd3e4a666 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: .version_select at 0x7fb2ba328040>, body: {"keypair": {"name": "tempest-keypair-1450787217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAzldQDbzIbBFDs4GyU0FqjKj5HVbhSC4eIZnrHAF/hlQf6wBxaiU0KjTyuNlN+32/ypaI5FQZ0Epjr3ehUq0U8WYOXHUvvGWRFpr6Z/JcomYDuuzl6w9a0Sb58ALY6kw=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:50.678940 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-08bf60e6-95e8-49c8-b862-f6fdd3e4a666 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:44:50.683237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-08bf60e6-95e8-49c8-b862-f6fdd3e4a666 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:44:50.788238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08bf60e6-95e8-49c8-b862-f6fdd3e4a666 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.405348 Aug 08 02:44:50.789059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 516/1026] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:44:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:53.358957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1691654429", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87421ac7-3501-495d-abd1-cf8008d9c1cb"}], "security_groups": [{"name": "tempest-securitygroup--1445601161"}], "key_name": "tempest-keypair-1450787217", "user_data": "}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:53.372108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:53.373053 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=17 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:53.484972 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] validate_networks() for [('87421ac7-3501-495d-abd1-cf8008d9c1cb', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:44:53.946008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:44:53.946544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:44:53.947017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:44:53.947422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:44:53.948003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:44:53.959016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:53.959588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:53.960082 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:53.960888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:53.961713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:53.962204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:53.980616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:44:53.984762 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:44:53.996705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:44:53.998914 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:44:54.127518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-583b5f4f-70e1-4546-8430-3128a8ace56a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.774487 Aug 08 02:44:54.128910 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 511/1027] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:44:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:44:54.140221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1f87ec3c-d48d-4199-af0a-c35b1c8a2e78 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:54.141394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1f87ec3c-d48d-4199-af0a-c35b1c8a2e78 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:54.209337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1f87ec3c-d48d-4199-af0a-c35b1c8a2e78 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:54.222911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1f87ec3c-d48d-4199-af0a-c35b1c8a2e78 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1242 microversion: 2.1 time: 0.087421 Aug 08 02:44:54.223599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 517/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:54 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:55.244294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:55.244964 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:55.251914 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:55.252480 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:55.253900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:55.254173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:55.254711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:55.255085 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:55.330881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:55.338987 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fbc8f03a-5a95-4062-88db-7ea58028dd1e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1246 microversion: 2.1 time: 0.098580 Aug 08 02:44:55.339551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 512/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:55 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:56.360050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:56.360669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:56.370094 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:56.373989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:56.373989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:56.373989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:56.373989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:56.374400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:56.437622 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:56.444885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bfffc5a8-d3ad-49e3-bad5-59dabc85932f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1312 microversion: 2.1 time: 0.088855 Aug 08 02:44:56.445442 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 518/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:56 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:57.466880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:57.467622 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:57.474520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:57.475013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:57.475450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:57.476148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:57.476789 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:57.477283 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:57.646820 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:57.654138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8e87c4a2-8da2-45b8-a530-ddf8c9c090ba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.191221 Aug 08 02:44:57.654738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 513/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:57 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:57.991739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-010a8909-b884-4556-82b9-9106186bea8c req-474dbca1-5c40-41f6-9744-b007e4d3799f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7aefc19-4687-4608-95c1-07161c73b0f0", "tag": "b1cd355c-17b9-4b63-9354-70d58ac3d6df"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:58.002568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-010a8909-b884-4556-82b9-9106186bea8c req-474dbca1-5c40-41f6-9744-b007e4d3799f service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:58.003375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-010a8909-b884-4556-82b9-9106186bea8c req-474dbca1-5c40-41f6-9744-b007e4d3799f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:58.003828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-010a8909-b884-4556-82b9-9106186bea8c req-474dbca1-5c40-41f6-9744-b007e4d3799f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:58.014858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-010a8909-b884-4556-82b9-9106186bea8c req-474dbca1-5c40-41f6-9744-b007e4d3799f service nova] Creating event network-changed:b1cd355c-17b9-4b63-9354-70d58ac3d6df for instance f7aefc19-4687-4608-95c1-07161c73b0f0 on hv-cinder-85226 Aug 08 02:44:58.019897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-010a8909-b884-4556-82b9-9106186bea8c req-474dbca1-5c40-41f6-9744-b007e4d3799f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033124 Aug 08 02:44:58.020555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 519/1032] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:58.677124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:58.678495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:58.684906 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:58.685392 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:58.685835 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:58.686567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:58.687026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:58.687636 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:58.826540 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:58.834898 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4a0dd016-a29e-4a58-8c82-e12f74e8e072 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.163231 Aug 08 02:44:58.835459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 514/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:58 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:59.855853 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:59.856579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:59.863004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:59.863489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:59.863933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:59.864650 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:59.865108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:59.865536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:00.034991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:00.042571 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-16450cbe-d2e9-480b-9864-36cd706c3917 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.191391 Aug 08 02:45:00.043175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 520/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:59 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:01.066946 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:01.068381 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:01.075135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:01.075705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:01.076219 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:01.076929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:01.077387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:01.077845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:01.248609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:01.257061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-48ab8e90-fdbf-4b55-9351-43ce869ee755 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.194762 Aug 08 02:45:01.257641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 515/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:01 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:02.277653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:02.278210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:02.285214 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:02.285683 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:02.286117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:02.286828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:02.287278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:02.287696 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:02.419823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:02.427333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47ac1878-fb98-405c-b048-0ef01118d244 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.153629 Aug 08 02:45:02.427889 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 521/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:02 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:02.987866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-ba046e74-eed1-419f-ab00-eec12e4bf29f req-b964e09b-347c-4cbc-bfcb-eb53c50c00b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7aefc19-4687-4608-95c1-07161c73b0f0", "name": "network-vif-plugged", "status": "completed", "tag": "b1cd355c-17b9-4b63-9354-70d58ac3d6df"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:02.997911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-ba046e74-eed1-419f-ab00-eec12e4bf29f req-b964e09b-347c-4cbc-bfcb-eb53c50c00b9 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:02.998484 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-ba046e74-eed1-419f-ab00-eec12e4bf29f req-b964e09b-347c-4cbc-bfcb-eb53c50c00b9 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:02.998975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-ba046e74-eed1-419f-ab00-eec12e4bf29f req-b964e09b-347c-4cbc-bfcb-eb53c50c00b9 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:03.013455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-ba046e74-eed1-419f-ab00-eec12e4bf29f req-b964e09b-347c-4cbc-bfcb-eb53c50c00b9 service nova] Creating event network-vif-plugged:b1cd355c-17b9-4b63-9354-70d58ac3d6df for instance f7aefc19-4687-4608-95c1-07161c73b0f0 on hv-cinder-85226 Aug 08 02:45:03.018887 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-ba046e74-eed1-419f-ab00-eec12e4bf29f req-b964e09b-347c-4cbc-bfcb-eb53c50c00b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226055 Aug 08 02:45:03.020177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 516/1037] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:03.448387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:03.449390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:03.456125 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:03.456617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:03.457062 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:03.457770 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:03.458316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:03.459000 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:03.591303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:03.599657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-176131c7-6524-4977-8c24-cfce6fbc6f63 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.155655 Aug 08 02:45:03.600374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 522/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:03 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:04.621383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:04.622071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:04.624440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:04.625208 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:04.630825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:04.631299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:04.631722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:04.632396 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:04.632842 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:04.633259 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:04.794043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:04.801990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7cc15126-6ce7-43d7-9a27-7d28db91733a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1368 microversion: 2.1 time: 0.184808 Aug 08 02:45:04.802963 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 517/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:04 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:05.822805 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:05.823530 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:05.825768 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:05.831080 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:05.831710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:05.832221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:05.832986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:05.833513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:05.834037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:05.977209 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:05.984609 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-41e8255c-6eec-4c66-918c-70ac797012d9 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1558 microversion: 2.1 time: 0.165723 Aug 08 02:45:05.985170 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 523/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:05 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:06.006461 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:06.007050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:06.013593 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:06.014136 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:06.014660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:06.015439 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:06.015959 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:06.016442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:06.099459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1a0d1bd8-e312-4518-a1be-8a83624d8fd0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097335 Aug 08 02:45:06.100038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 518/1041] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:45:06 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:07.329677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-539f8700-94e9-45c8-8159-f5942848f837 req-8a2df3e8-3e0e-4afe-9328-935dd70e78ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7aefc19-4687-4608-95c1-07161c73b0f0", "tag": "b1cd355c-17b9-4b63-9354-70d58ac3d6df"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:07.339825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-539f8700-94e9-45c8-8159-f5942848f837 req-8a2df3e8-3e0e-4afe-9328-935dd70e78ce service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:07.340311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-539f8700-94e9-45c8-8159-f5942848f837 req-8a2df3e8-3e0e-4afe-9328-935dd70e78ce service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:07.340880 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-539f8700-94e9-45c8-8159-f5942848f837 req-8a2df3e8-3e0e-4afe-9328-935dd70e78ce service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:07.358750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-539f8700-94e9-45c8-8159-f5942848f837 req-8a2df3e8-3e0e-4afe-9328-935dd70e78ce service nova] Creating event network-changed:b1cd355c-17b9-4b63-9354-70d58ac3d6df for instance f7aefc19-4687-4608-95c1-07161c73b0f0 on hv-cinder-85226 Aug 08 02:45:07.359361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-539f8700-94e9-45c8-8159-f5942848f837 req-8a2df3e8-3e0e-4afe-9328-935dd70e78ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 Aug 08 02:45:07.361053 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 524/1042] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:10.271899 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1450269807", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "networks": [{"uuid": "5f858564-73e7-417d-aecd-d7e0bdab1ebf"}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:10.324888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] validate_networks() for [('5f858564-73e7-417d-aecd-d7e0bdab1ebf', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:45:10.675560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:45:10.676018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:45:10.676491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:45:10.676929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:45:10.677361 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:45:10.686316 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:10.686840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:10.687273 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:10.688099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:10.688553 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:10.688975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:10.705400 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Getting quotas for project c3703fa0da4a45d8b49bf637d12e3f21. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:45:10.709703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Getting quotas for user 44565ea5afce40aba02902b89b76a5f1 and project c3703fa0da4a45d8b49bf637d12e3f21. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:45:10.720705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:45:10.723608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:45:10.849755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94424fbf-213d-4f08-91e7-2ec4715155c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582933 Aug 08 02:45:10.850423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 519/1043] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:45:10.862068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bdb0bc0a-fb38-46a0-912f-b608ede4f408 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:10.862771 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bdb0bc0a-fb38-46a0-912f-b608ede4f408 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:10.916177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bdb0bc0a-fb38-46a0-912f-b608ede4f408 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:10.922920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bdb0bc0a-fb38-46a0-912f-b608ede4f408 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1214 microversion: 2.1 time: 0.065532 Aug 08 02:45:10.923484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 525/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:10 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:11.944038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e1c51467-b863-4936-ad26-d167166ece92 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:11.944656 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e1c51467-b863-4936-ad26-d167166ece92 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:11.996604 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e1c51467-b863-4936-ad26-d167166ece92 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:12.004066 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e1c51467-b863-4936-ad26-d167166ece92 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1214 microversion: 2.1 time: 0.064435 Aug 08 02:45:12.004616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 520/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:11 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:13.024262 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3715773b-41e5-4f7b-a9b2-b3f7dd8a4a76 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:13.024913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3715773b-41e5-4f7b-a9b2-b3f7dd8a4a76 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:13.079399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3715773b-41e5-4f7b-a9b2-b3f7dd8a4a76 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:13.086493 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3715773b-41e5-4f7b-a9b2-b3f7dd8a4a76 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1214 microversion: 2.1 time: 0.065997 Aug 08 02:45:13.087063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 526/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:13 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:14.107974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-67be7fa7-0af0-4471-93c6-ae5325713d0b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:14.108587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-67be7fa7-0af0-4471-93c6-ae5325713d0b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:14.162474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-67be7fa7-0af0-4471-93c6-ae5325713d0b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:14.169094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-67be7fa7-0af0-4471-93c6-ae5325713d0b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1214 microversion: 2.1 time: 0.065102 Aug 08 02:45:14.169654 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 521/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:14 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:15.189016 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:15.189630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:15.197048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:15.197528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:15.197965 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:15.198948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:15.199399 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:15.199824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:15.263119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:15.271092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9d5fed08-a99a-4030-ba55-e33244d845e0 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1218 microversion: 2.1 time: 0.085939 Aug 08 02:45:15.271655 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 527/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:15 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:16.291545 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:16.292159 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:16.298657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:16.299127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:16.300270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:16.301466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:16.301939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:16.302390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:16.369498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:16.377013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3638cdce-9401-4a4a-a31b-75f1c74a7b2a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1210 microversion: 2.1 time: 0.089775 Aug 08 02:45:16.378261 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 522/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:16 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:17.399913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:17.400677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:17.407123 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:17.407612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:17.408053 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:17.408960 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:17.409438 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:17.409899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:17.474734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:17.482214 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec38748f-416a-4784-84df-3faa188d5dc4 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1272 microversion: 2.1 time: 0.086289 Aug 08 02:45:17.482813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 528/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:17 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:45:18.504139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:18.505587 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-478c39d1-4958-44d7-81c8-eaf1837bcfed req-167d2f36-b29f-42d9-9ca5-503518b49c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cd6500-8ca3-4ce6-afc8-567882abe313", "tag": "528d1cae-f88b-4dd9-8db3-c64b1680b0cd"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:18.506031 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:18.512463 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:18.513226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:18.513670 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:18.514389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:18.514944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:18.515787 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:18.516460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-478c39d1-4958-44d7-81c8-eaf1837bcfed req-167d2f36-b29f-42d9-9ca5-503518b49c97 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:18.517032 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-478c39d1-4958-44d7-81c8-eaf1837bcfed req-167d2f36-b29f-42d9-9ca5-503518b49c97 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:18.517457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-478c39d1-4958-44d7-81c8-eaf1837bcfed req-167d2f36-b29f-42d9-9ca5-503518b49c97 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:18.530956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-478c39d1-4958-44d7-81c8-eaf1837bcfed req-167d2f36-b29f-42d9-9ca5-503518b49c97 service nova] Creating event network-changed:528d1cae-f88b-4dd9-8db3-c64b1680b0cd for instance a2cd6500-8ca3-4ce6-afc8-567882abe313 on hv-cinder-85226 Aug 08 02:45:18.537188 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-478c39d1-4958-44d7-81c8-eaf1837bcfed req-167d2f36-b29f-42d9-9ca5-503518b49c97 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035331 Aug 08 02:45:18.537942 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 529/1051] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:18.745588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:18.753764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bc2464f5-00b2-461b-93e0-26699245f9c8 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.253887 Aug 08 02:45:18.754260 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 523/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:18 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:19.775868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:19.776594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:19.782705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:19.783204 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:19.783640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:19.784357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:19.784807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:19.785235 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:19.913627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:19.924094 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7a22dab4-6e11-4583-a648-908c2ed63aa3 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.152912 Aug 08 02:45:19.925695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 530/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:19 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:20.944617 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:20.945606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:20.947907 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:20.952955 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:20.953433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:20.953869 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:20.954636 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:20.955091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:20.956016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:21.088594 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:21.095801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d156ed34-4a0a-4d66-bded-be2ca111e750 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.155598 Aug 08 02:45:21.097699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 524/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:20 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:22.118192 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:22.118865 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:22.121256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:22.125846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:22.126320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:22.126779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:22.127490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:22.128094 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:22.128520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:22.261170 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:22.268927 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1ea2118a-fcd6-4bd1-8230-e91729c0e16e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.154587 Aug 08 02:45:22.269500 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 531/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:22 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:23.290705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:23.291294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:23.297533 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:23.298008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:23.298470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:23.299714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:23.300098 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:23.300545 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:23.430449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:23.437852 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7309804b-35b7-4af5-a8ed-c61083d8d78c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.151025 Aug 08 02:45:23.438514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 525/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:23 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:24.459527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:24.460139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:24.462036 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:24.467439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:24.467928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:24.468402 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:24.469289 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:24.469689 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:24.470126 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:24.472979 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=61 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:24.599825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:24.607166 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6208c2a6-5991-4bd8-b68c-7ea830f355c9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.152151 Aug 08 02:45:24.607730 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 532/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:24 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:24.899473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-88a20358-bd29-4a37-81c0-a2074d0bf83d req-37179ff4-5610-49bc-b1ac-7a117d602fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cd6500-8ca3-4ce6-afc8-567882abe313", "name": "network-vif-plugged", "status": "completed", "tag": "528d1cae-f88b-4dd9-8db3-c64b1680b0cd"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:24.905514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=10 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:24.909303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:24.911209 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-88a20358-bd29-4a37-81c0-a2074d0bf83d req-37179ff4-5610-49bc-b1ac-7a117d602fef service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:24.911685 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-88a20358-bd29-4a37-81c0-a2074d0bf83d req-37179ff4-5610-49bc-b1ac-7a117d602fef service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:24.912120 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-88a20358-bd29-4a37-81c0-a2074d0bf83d req-37179ff4-5610-49bc-b1ac-7a117d602fef service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:24.915943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=65 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:24.923723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-88a20358-bd29-4a37-81c0-a2074d0bf83d req-37179ff4-5610-49bc-b1ac-7a117d602fef service nova] Creating event network-vif-plugged:528d1cae-f88b-4dd9-8db3-c64b1680b0cd for instance a2cd6500-8ca3-4ce6-afc8-567882abe313 on hv-cinder-85226 Aug 08 02:45:24.929862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-88a20358-bd29-4a37-81c0-a2074d0bf83d req-37179ff4-5610-49bc-b1ac-7a117d602fef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033752 Aug 08 02:45:24.930483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 526/1058] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:25.627227 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:25.627839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:25.634837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:25.635322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:25.635759 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:25.636451 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:25.636908 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:25.637335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:25.764375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:25.771862 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ef6228b8-beda-4db6-8c55-1b1b1a4d0990 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.148485 Aug 08 02:45:25.772425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 533/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:25 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:26.793875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:26.794785 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:26.803717 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:26.804235 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:26.804668 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:26.805364 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:26.805821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:26.806244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:26.937075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:26.945231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c6577e69-caf3-4100-a96c-465f3d287eab tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1314 microversion: 2.1 time: 0.156668 Aug 08 02:45:26.945792 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 527/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:26 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:27.965794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:27.966425 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:27.972882 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:27.973355 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:27.973787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:27.974505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:27.974954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:27.975376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:28.104158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:28.111623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-adb6bbff-bc13-4b2a-ae42-4af75c41932c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1498 microversion: 2.1 time: 0.149702 Aug 08 02:45:28.112191 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 534/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:27 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:28.857214 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:28.857746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:28.864251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:28.864873 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:28.865306 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:28.866048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:28.866537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:28.866953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:28.892196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:45:29.135227 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-42ef37fd-fd95-40ac-baa7-1ceeabf54a9d tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 204 len: 0 microversion: 2.1 time: 0.281122 Aug 08 02:45:29.135768 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 528/1062] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:45:28 2022] DELETE /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:45:29.144034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:29.147668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:29.154339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:29.158297 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:29.158297 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:29.158297 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:29.158297 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:29.158715 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:29.287854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:29.295260 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6f052224-2b65-476d-8d27-638e42013c27 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1504 microversion: 2.1 time: 0.155131 Aug 08 02:45:29.295837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 535/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:29 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:30.317013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:30.318291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:30.324985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:30.325466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:30.325901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:30.326616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:30.327077 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:30.327503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:30.460104 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:30.467831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-12374617-cbb3-4902-9afe-1afa36e4554e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1504 microversion: 2.1 time: 0.155126 Aug 08 02:45:30.468441 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 529/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:30 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:31.227127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-c0fbc072-4563-4648-83f9-9925a807d651 req-a623c10f-d966-49c9-8cce-a61e5d62bc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cd6500-8ca3-4ce6-afc8-567882abe313", "name": "network-vif-deleted", "tag": "528d1cae-f88b-4dd9-8db3-c64b1680b0cd"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:31.236961 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c0fbc072-4563-4648-83f9-9925a807d651 req-a623c10f-d966-49c9-8cce-a61e5d62bc5c service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:31.237432 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c0fbc072-4563-4648-83f9-9925a807d651 req-a623c10f-d966-49c9-8cce-a61e5d62bc5c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:31.238505 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c0fbc072-4563-4648-83f9-9925a807d651 req-a623c10f-d966-49c9-8cce-a61e5d62bc5c service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:31.250120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-c0fbc072-4563-4648-83f9-9925a807d651 req-a623c10f-d966-49c9-8cce-a61e5d62bc5c service nova] Creating event network-vif-deleted:528d1cae-f88b-4dd9-8db3-c64b1680b0cd for instance a2cd6500-8ca3-4ce6-afc8-567882abe313 on hv-cinder-85226 Aug 08 02:45:31.255742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-c0fbc072-4563-4648-83f9-9925a807d651 req-a623c10f-d966-49c9-8cce-a61e5d62bc5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Aug 08 02:45:31.256332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 536/1065] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:45:31.490480 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:31.491002 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:31.497573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:31.500579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:31.500579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:31.500579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:31.500579 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:31.500971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:31.563059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:31.571532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-58bce260-cb36-48af-8f3f-d33a95768a51 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 200 len: 1299 microversion: 2.1 time: 0.086197 Aug 08 02:45:31.572133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 530/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:31 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:32.593851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:32.594573 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: a2cd6500-8ca3-4ce6-afc8-567882abe313] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:32.601327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:32.601807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:32.602239 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:32.602947 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:32.603395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:32.603813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:32.617407 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] HTTP exception thrown: Instance a2cd6500-8ca3-4ce6-afc8-567882abe313 could not be found. Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Request method failure captured: Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 HTTP/1.1 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8Hi04nZOzmdpe2GEZYqWphFHcwIpqeAQMU8Ga6XT9u3m4T9bTDpLXeeMXY-wuAjTrCq3CjmDa8WNILnE7l9B8b6pv11GVdsgj1VntjHmbbyupg6likfSyJcMcKPAxnPSlWwQxcr8MFIOBySh4iG70YEEen2X1TrIotaWMt1s3IiLNI8 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: c3703fa0da4a45d8b49bf637d12e3f21 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesActionsTest-1952200286 Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:45:32.619024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesActionsTest-1952200286 Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: c3703fa0da4a45d8b49bf637d12e3f21 Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesActionsTest-1952200286 Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesActionsTest-1952200286-project Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 44565ea5afce40aba02902b89b76a5f1 Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesActionsTest-1952200286-project Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance a2cd6500-8ca3-4ce6-afc8-567882abe313 could not be found. Aug 08 02:45:32.620734 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'a2cd6500-8ca3-4ce6-afc8-567882abe313'} Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cd6500-8ca3-4ce6-afc8-567882abe313 could not be found. Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:45:32.621875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cd6500-8ca3-4ce6-afc8-567882abe313 could not be found. Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cd6500-8ca3-4ce6-afc8-567882abe313 could not be found. Aug 08 02:45:32.623544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:45:32.625000 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Returning 404 to user: Instance a2cd6500-8ca3-4ce6-afc8-567882abe313 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:45:32.625000 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8886cfae-b3ed-4886-bf61-43a18272c824 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313" status: 404 len: 111 microversion: 2.1 time: 0.031191 Aug 08 02:45:32.625000 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 537/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:32 2022] GET /compute/v2.1/servers/a2cd6500-8ca3-4ce6-afc8-567882abe313 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:45:32.670078 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-700137622", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "networks": [{"uuid": "5f858564-73e7-417d-aecd-d7e0bdab1ebf"}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:32.723328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] validate_networks() for [('5f858564-73e7-417d-aecd-d7e0bdab1ebf', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:45:33.296171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:45:33.296587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:45:33.297053 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:45:33.297455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:45:33.297888 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:45:33.307503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:33.307977 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:33.308410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:33.309121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:33.309571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:33.309986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:33.326819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Getting quotas for project c3703fa0da4a45d8b49bf637d12e3f21. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:45:33.330683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Getting quotas for user 44565ea5afce40aba02902b89b76a5f1 and project c3703fa0da4a45d8b49bf637d12e3f21. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:45:33.341576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:45:33.343800 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:45:33.478683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d9f92963-a5e6-4975-b96b-7f8662334aee tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812211 Aug 08 02:45:33.479246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 531/1068] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:45:33.490453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-351ec6cb-de41-4623-9dad-af0dd8d8f4cc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:33.491182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-351ec6cb-de41-4623-9dad-af0dd8d8f4cc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:33.548148 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-351ec6cb-de41-4623-9dad-af0dd8d8f4cc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:33.555298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-351ec6cb-de41-4623-9dad-af0dd8d8f4cc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1213 microversion: 2.1 time: 0.069191 Aug 08 02:45:33.555851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 538/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:33 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:45:34.576458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:34.577084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:34.586094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:34.587956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:34.587956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:34.587956 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:34.588425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:34.588559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:34.649078 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:34.656598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f3638bd6-55b0-40c5-9f92-9af268b30b47 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1209 microversion: 2.1 time: 0.084754 Aug 08 02:45:34.657382 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 532/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:34 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:35.678538 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:35.679154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:35.686779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:35.687266 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:35.687705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:35.688408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:35.688899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:35.689328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:35.751368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:35.759479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-551222a2-a4fd-4ef1-a973-5dd94f81fe7b tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1271 microversion: 2.1 time: 0.085439 Aug 08 02:45:35.760043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 539/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:35 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:36.768029 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-5a517f10-653d-4657-a0b6-6a253be188e6 req-a24e27c7-b0c9-40c3-8ca2-aab5ea40bab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a4f522-b796-4b4b-93ea-22830c71c58b", "tag": "d40acf67-0110-4e90-8392-ef20aebecb5a"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:36.779723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5a517f10-653d-4657-a0b6-6a253be188e6 req-a24e27c7-b0c9-40c3-8ca2-aab5ea40bab8 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:36.780490 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5a517f10-653d-4657-a0b6-6a253be188e6 req-a24e27c7-b0c9-40c3-8ca2-aab5ea40bab8 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:36.780636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:36.783452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5a517f10-653d-4657-a0b6-6a253be188e6 req-a24e27c7-b0c9-40c3-8ca2-aab5ea40bab8 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:36.783611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:36.789516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:36.790005 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:36.790479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:36.791185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:36.791639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:36.792060 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:36.793038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-5a517f10-653d-4657-a0b6-6a253be188e6 req-a24e27c7-b0c9-40c3-8ca2-aab5ea40bab8 service nova] Creating event network-changed:d40acf67-0110-4e90-8392-ef20aebecb5a for instance e5a4f522-b796-4b4b-93ea-22830c71c58b on hv-cinder-85226 Aug 08 02:45:36.798427 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-5a517f10-653d-4657-a0b6-6a253be188e6 req-a24e27c7-b0c9-40c3-8ca2-aab5ea40bab8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Aug 08 02:45:36.799409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 533/1072] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:36.925871 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:36.934470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-97117173-4f2b-4c81-8938-93573933b8b5 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.157934 Aug 08 02:45:36.940294 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 540/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:36 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:37.956017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:37.956711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:37.963561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:37.964040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:37.964471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:37.965160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:37.965612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:37.966033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:38.102129 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:38.109473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5d5897e0-8b0d-4ee5-8a48-ab5d1c82a79e tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.158184 Aug 08 02:45:38.110041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 534/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:37 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:39.129806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:39.131108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:39.137140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:39.137614 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:39.138046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:39.138763 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:39.139217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:39.139637 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:39.270661 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:39.278879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8a8fa91f-e4c1-470c-81c5-8e2de60b1478 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.153005 Aug 08 02:45:39.279434 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 541/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:39 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:40.299019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:40.299644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:40.306847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:40.307328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:40.307759 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:40.308452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:40.308903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:40.309447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:40.438227 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:40.446110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ee6c6a55-6bbf-4b80-8481-567dd9e69715 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.150956 Aug 08 02:45:40.446703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 535/1076] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:40 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:41.467462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:41.468066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:41.475113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:41.475582 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:41.476012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:41.476692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:41.477149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:41.477560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:41.605175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:41.612507 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-561e225f-c7d7-4331-960b-f3463463f6e7 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.148914 Aug 08 02:45:41.613068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 542/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:41 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:42.635025 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:42.635633 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:42.642004 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:42.642506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:42.642934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:42.643608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:42.644055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:42.644473 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:42.774132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:42.781654 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6c94f0e0-6b85-4c78-b9c4-493b2f40bb23 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.151506 Aug 08 02:45:42.782432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 536/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:42 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:43.803303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:43.803918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:43.806383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:43.811194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:43.811748 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:43.812625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:43.813328 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:43.813787 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:43.814220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:43.947647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:43.955381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f9f0cc89-f8e8-47c5-a060-cf216f365a24 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.156122 Aug 08 02:45:43.955957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 543/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:43 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:44.976573 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:44.977181 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:44.979500 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:44.979607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-3320306f-193a-4da8-b415-0d95daf0f534 req-b2ed6ff9-5801-448c-837c-72cc52534342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a4f522-b796-4b4b-93ea-22830c71c58b", "name": "network-vif-plugged", "status": "completed", "tag": "d40acf67-0110-4e90-8392-ef20aebecb5a"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:44.979995 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:45:44.985139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:44.985620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:44.986048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:44.986779 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:44.987227 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:44.987648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:44.990660 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3320306f-193a-4da8-b415-0d95daf0f534 req-b2ed6ff9-5801-448c-837c-72cc52534342 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:44.991141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3320306f-193a-4da8-b415-0d95daf0f534 req-b2ed6ff9-5801-448c-837c-72cc52534342 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:44.991576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3320306f-193a-4da8-b415-0d95daf0f534 req-b2ed6ff9-5801-448c-837c-72cc52534342 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:45.004497 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-3320306f-193a-4da8-b415-0d95daf0f534 req-b2ed6ff9-5801-448c-837c-72cc52534342 service nova] Creating event network-vif-plugged:d40acf67-0110-4e90-8392-ef20aebecb5a for instance e5a4f522-b796-4b4b-93ea-22830c71c58b on hv-cinder-85226 Aug 08 02:45:45.010367 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-3320306f-193a-4da8-b415-0d95daf0f534 req-b2ed6ff9-5801-448c-837c-72cc52534342 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034783 Aug 08 02:45:45.010965 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 544/1080] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:45:45.136863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:45.144602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d8048be6-1696-459c-ba8c-6fc25737bf9c tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.172363 Aug 08 02:45:45.145488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 537/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:44 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:46.166816 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:46.167525 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:46.173671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:46.174153 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:46.174685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:46.175329 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:46.175818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:46.176251 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:46.309346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:46.316743 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-40686eb9-bd37-4db7-8585-6eb88bd21215 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1313 microversion: 2.1 time: 0.154917 Aug 08 02:45:46.317898 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 545/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:46 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:47.340915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:47.341519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:47.347558 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:47.348036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:47.348541 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:47.349341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:47.349795 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:47.350217 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:47.483144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:47.490920 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6225f873-432d-4750-b446-b5ff0c2a96fb tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1496 microversion: 2.1 time: 0.153908 Aug 08 02:45:47.491489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 538/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:47 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:48.159957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:48.160489 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:48.167271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:48.167741 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:48.168171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:48.168858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:48.169306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:48.169726 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:48.195579 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:45:48.408082 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-83244630-904f-461f-907e-cdeb978faab9 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 204 len: 0 microversion: 2.1 time: 0.251661 Aug 08 02:45:48.408586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 546/1084] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:45:48 2022] DELETE /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:45:48.417869 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:48.418513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:48.426177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:48.427531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:48.427974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:48.428684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:48.429162 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:48.429585 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:48.560705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:48.568590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-285d75d2-bc38-4c1d-8350-28613cfffcfc tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1502 microversion: 2.1 time: 0.155044 Aug 08 02:45:48.569168 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 539/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:48 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:45:49.589631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:49.590322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:49.596668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:49.597143 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:49.597577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:49.598258 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:49.599229 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:49.599652 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:49.728301 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:49.735814 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-16dec72e-4d52-482f-b341-d0fadc94a44a tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1502 microversion: 2.1 time: 0.150430 Aug 08 02:45:49.736379 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 547/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:49 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:50.398161 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-62fb4fd0-873c-407c-9ca4-b37e1491ffce req-46b8144e-4a20-4f29-b24c-ee8a7b566614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a4f522-b796-4b4b-93ea-22830c71c58b", "name": "network-vif-deleted", "tag": "d40acf67-0110-4e90-8392-ef20aebecb5a"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:45:50.407891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-62fb4fd0-873c-407c-9ca4-b37e1491ffce req-46b8144e-4a20-4f29-b24c-ee8a7b566614 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:50.408362 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-62fb4fd0-873c-407c-9ca4-b37e1491ffce req-46b8144e-4a20-4f29-b24c-ee8a7b566614 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:50.408790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-62fb4fd0-873c-407c-9ca4-b37e1491ffce req-46b8144e-4a20-4f29-b24c-ee8a7b566614 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:50.420368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-62fb4fd0-873c-407c-9ca4-b37e1491ffce req-46b8144e-4a20-4f29-b24c-ee8a7b566614 service nova] Creating event network-vif-deleted:d40acf67-0110-4e90-8392-ef20aebecb5a for instance e5a4f522-b796-4b4b-93ea-22830c71c58b on hv-cinder-85226 Aug 08 02:45:50.425415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-62fb4fd0-873c-407c-9ca4-b37e1491ffce req-46b8144e-4a20-4f29-b24c-ee8a7b566614 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Aug 08 02:45:50.426012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 540/1087] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:45:50.757902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:50.758572 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:50.765025 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:50.765600 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:50.766022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:50.766750 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:50.767236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:50.767662 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:50.797719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:50.798193 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:50.798670 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:50.799113 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lazy-loading 'fault' on Instance uuid e5a4f522-b796-4b4b-93ea-22830c71c58b {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:45:50.846092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44565ea5afce40aba02902b89b76a5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3703fa0da4a45d8b49bf637d12e3f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:45:50.854278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d623e245-e2da-429e-b133-ed967fb2c616 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 200 len: 1303 microversion: 2.1 time: 0.101069 Aug 08 02:45:50.854954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 548/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:50 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:45:51.877733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:45:51.878590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] [instance: e5a4f522-b796-4b4b-93ea-22830c71c58b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:45:51.885524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:51.886003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:51.886468 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:51.887157 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:45:51.887609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:45:51.888030 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:45:51.901984 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] HTTP exception thrown: Instance e5a4f522-b796-4b4b-93ea-22830c71c58b could not be found. Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Request method failure captured: Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b HTTP/1.1 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8Hi04nZOzmdpe2GEZYqWphFHcwIpqeAQMU8Ga6XT9u3m4T9bTDpLXeeMXY-wuAjTrCq3CjmDa8WNILnE7l9B8b6pv11GVdsgj1VntjHmbbyupg6likfSyJcMcKPAxnPSlWwQxcr8MFIOBySh4iG70YEEen2X1TrIotaWMt1s3IiLNI8 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: c3703fa0da4a45d8b49bf637d12e3f21 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-VolumesActionsTest-1952200286 Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:45:51.903619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c3703fa0da4a45d8b49bf637d12e3f21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-VolumesActionsTest-1952200286 Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: c3703fa0da4a45d8b49bf637d12e3f21 Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-VolumesActionsTest-1952200286 Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-VolumesActionsTest-1952200286-project Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 44565ea5afce40aba02902b89b76a5f1 Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-VolumesActionsTest-1952200286-project Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance e5a4f522-b796-4b4b-93ea-22830c71c58b could not be found. Aug 08 02:45:51.905257 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'e5a4f522-b796-4b4b-93ea-22830c71c58b'} Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a4f522-b796-4b4b-93ea-22830c71c58b could not be found. Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:45:51.906124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a4f522-b796-4b4b-93ea-22830c71c58b could not be found. Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a4f522-b796-4b4b-93ea-22830c71c58b could not be found. Aug 08 02:45:51.907452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:45:51.908601 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] Returning 404 to user: Instance e5a4f522-b796-4b4b-93ea-22830c71c58b could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:45:51.908601 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-441162a9-cf3b-456e-89ee-2502900ada52 tempest-VolumesActionsTest-1952200286 tempest-VolumesActionsTest-1952200286-project] 10.222.0.15 "GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b" status: 404 len: 111 microversion: 2.1 time: 0.032089 Aug 08 02:45:51.908601 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 541/1089] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:45:51 2022] GET /compute/v2.1/servers/e5a4f522-b796-4b4b-93ea-22830c71c58b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:46:34.406923 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:34.407546 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:34.409615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:34.410381 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:34.415713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:34.416201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:34.416642 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:34.417338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:34.417899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:34.418327 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:34.441881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c5e9ee4f-b617-4774-8f6f-500d6cf2c062 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/ips" status: 200 len: 149 microversion: 2.1 time: 0.039193 Aug 08 02:46:34.442465 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 549/1090] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:46:34 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:36.148352 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d92c48-c3d1-44aa-bd32-9c848b858333"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:36.150940 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:36.153041 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:36.153683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:36.158335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:36.158864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:36.159354 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:36.159975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:36.160470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:36.160838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:36.823629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a6a25149-758f-4553-b496-fd744f9777e1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679072 Aug 08 02:46:36.824260 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 542/1091] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:46:36 2022] POST /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:44.358178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8daf7b40-f7de-4f4c-aa2b-0770b5afa33f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: .version_select at 0x7fb2ba1c8a60>, body: {"keypair": {"name": "tempest-keypair-1293216068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ/GY3CTgZ6kJ1MWODMJPrOvDs/QzcgooGtBbMVJ9TRm0bkyURdMrIG0ChXsK9fbYhNI8VfgND5mCAm00HCe6SCEkiC0N7qE7HnKiILHQPpR4cBx6Qxf41Vz7BYg7kGiQ=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:44.375070 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-8daf7b40-f7de-4f4c-aa2b-0770b5afa33f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:46:44.379092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-8daf7b40-f7de-4f4c-aa2b-0770b5afa33f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:46:44.453617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8daf7b40-f7de-4f4c-aa2b-0770b5afa33f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099661 Aug 08 02:46:44.454218 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 550/1092] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:46:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:46.546047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1871082032", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87421ac7-3501-495d-abd1-cf8008d9c1cb"}], "security_groups": [{"name": "tempest-securitygroup--2101137906"}], "key_name": "tempest-keypair-1293216068", "user_data": "}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:46.554968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:46.656055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] validate_networks() for [('87421ac7-3501-495d-abd1-cf8008d9c1cb', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:46:46.752253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:47.113361 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:46:47.113784 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:46:47.114261 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:46:47.114713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:46:47.115124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:46:47.124446 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:47.124928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:47.125368 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:47.126128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:47.126616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:47.127046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:47.143919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:46:47.147879 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:46:47.159845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:46:47.162169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:46:47.290605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d4e238a9-fe8c-4939-8907-040e14ff2ff4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749294 Aug 08 02:46:47.292371 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 543/1093] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:46:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:46:47.304326 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4cb78a85-fc9c-4752-bb4a-50b3c2c292fb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:47.304934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4cb78a85-fc9c-4752-bb4a-50b3c2c292fb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:47.364221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4cb78a85-fc9c-4752-bb4a-50b3c2c292fb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:47.371509 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4cb78a85-fc9c-4752-bb4a-50b3c2c292fb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1242 microversion: 2.1 time: 0.072231 Aug 08 02:46:47.372234 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 551/1094] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:47 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:48.392342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:48.393144 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:48.400875 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:48.401372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:48.401813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:48.402547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:48.403009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:48.403437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:48.470458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:48.476013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9ae5c027-3927-4e60-b7ae-e7c0f1cc470f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1246 microversion: 2.1 time: 0.087702 Aug 08 02:46:48.476568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 544/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:48 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:49.497857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:49.498560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:49.505939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:49.506457 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:49.506895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:49.507599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:49.508053 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:49.508481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:49.573066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:49.580669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-298b1a48-56fc-44f8-b979-b6a915983385 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1300 microversion: 2.1 time: 0.087535 Aug 08 02:46:49.594144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 552/1096] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:49 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:50.601150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:50.601706 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:50.608516 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:50.609005 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:50.609444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:50.610150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:50.610629 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:50.611056 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:50.758046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:50.765749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1c367275-a0b8-4ad7-8506-11c3015011fe tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.168594 Aug 08 02:46:50.766535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 545/1097] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:50 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:50.784506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-f98debc3-4b01-40e1-b9de-84706da6b619 req-c8fda691-7863-4b27-9f57-a6cd542fba16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26342276-eba9-44e6-9959-33387a610f2b", "tag": "0b82ba5b-f543-4f90-b789-ad00ac22ad04"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:50.794788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f98debc3-4b01-40e1-b9de-84706da6b619 req-c8fda691-7863-4b27-9f57-a6cd542fba16 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:50.795262 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f98debc3-4b01-40e1-b9de-84706da6b619 req-c8fda691-7863-4b27-9f57-a6cd542fba16 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:50.795684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f98debc3-4b01-40e1-b9de-84706da6b619 req-c8fda691-7863-4b27-9f57-a6cd542fba16 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:50.807564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-f98debc3-4b01-40e1-b9de-84706da6b619 req-c8fda691-7863-4b27-9f57-a6cd542fba16 service nova] Creating event network-changed:0b82ba5b-f543-4f90-b789-ad00ac22ad04 for instance 26342276-eba9-44e6-9959-33387a610f2b on hv-cinder-85226 Aug 08 02:46:50.812341 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-f98debc3-4b01-40e1-b9de-84706da6b619 req-c8fda691-7863-4b27-9f57-a6cd542fba16 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031474 Aug 08 02:46:50.812925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 553/1098] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:51.786586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:51.787160 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:51.793835 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:51.796377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:51.796377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:51.796377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:51.796377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:51.796813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:51.930776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:51.938769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3694db2b-5229-4426-9f91-a2f4a08f25cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.156076 Aug 08 02:46:51.939341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 546/1099] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:51 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:52.960564 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:52.961304 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:52.967618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:52.968100 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:52.968540 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:52.969232 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:52.969707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:52.970140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:53.096938 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:53.104817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-185e74ea-a5e8-43fc-a3ed-97ca35d7a1e7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.148908 Aug 08 02:46:53.105380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 554/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:52 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:54.125212 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:54.125818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:54.132141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:54.132614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:54.133043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:54.133722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:54.134167 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:54.134699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:54.263075 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:54.270335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d22aa86e-11c9-4dd2-96ce-10c243a1fd28 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.148963 Aug 08 02:46:54.271250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 547/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:54 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:46:55.292761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:55.293396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:55.299926 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:55.300406 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:55.300849 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:55.301543 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:55.302029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:55.302482 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:55.434646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:55.442756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a2eaae33-9206-48a4-89f7-1be73fc3af7b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.154024 Aug 08 02:46:55.443701 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 555/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:55 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:56.465477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:56.466087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:56.472461 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:56.472938 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:56.473372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:56.474054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:56.474542 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:56.474966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:56.605975 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:56.613303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-51ff3d78-0f9c-4872-a743-016834a56416 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.152410 Aug 08 02:46:56.613874 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 548/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:56 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:57.405642 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-2d04dec7-871b-437c-9435-bf30a1110310 req-979c2d85-aa55-4509-9162-6e945d171291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26342276-eba9-44e6-9959-33387a610f2b", "name": "network-vif-plugged", "status": "completed", "tag": "0b82ba5b-f543-4f90-b789-ad00ac22ad04"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:57.412048 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:57.416437 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2d04dec7-871b-437c-9435-bf30a1110310 req-979c2d85-aa55-4509-9162-6e945d171291 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:57.416907 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2d04dec7-871b-437c-9435-bf30a1110310 req-979c2d85-aa55-4509-9162-6e945d171291 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:57.417333 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2d04dec7-871b-437c-9435-bf30a1110310 req-979c2d85-aa55-4509-9162-6e945d171291 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:57.427902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-2d04dec7-871b-437c-9435-bf30a1110310 req-979c2d85-aa55-4509-9162-6e945d171291 service nova] Creating event network-vif-plugged:0b82ba5b-f543-4f90-b789-ad00ac22ad04 for instance 26342276-eba9-44e6-9959-33387a610f2b on hv-cinder-85226 Aug 08 02:46:57.433390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-2d04dec7-871b-437c-9435-bf30a1110310 req-979c2d85-aa55-4509-9162-6e945d171291 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031503 Aug 08 02:46:57.433895 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 556/1104] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:57.634121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:57.634922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:57.636773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:57.637442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:57.642673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:57.643152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:57.643587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:57.644274 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:57.644726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:57.645155 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:57.836159 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:57.844197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-17190741-f1d4-4ec3-9fd2-3d8f10c32504 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.213903 Aug 08 02:46:57.844773 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 549/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:57 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:58.867086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:58.867794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:58.874780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:58.875265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:58.875705 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:58.876404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:58.876858 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:58.877285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:59.005378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:59.012833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-597d7ed2-388f-4f6b-a0bc-b0d93a67cff3 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1368 microversion: 2.1 time: 0.150816 Aug 08 02:46:59.013394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 557/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:58 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:00.033384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:00.033926 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:00.041890 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:00.042410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:00.042841 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:00.043520 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:00.043973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:00.044390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:00.173778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:00.181954 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-48ad4182-1cc1-41a3-9f0d-43ddd77d1868 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1559 microversion: 2.1 time: 0.152473 Aug 08 02:47:00.182603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 550/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:00 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:00.203015 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:00.203517 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:00.209775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:00.210246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:00.210716 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:00.211401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:00.211847 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:00.212724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:00.287803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-12d92136-e45b-4ae0-a416-d7639ea23218 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088502 Aug 08 02:47:00.288470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 558/1108] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:47:00 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:47:01.625285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-e7e8f53b-53a1-453c-9cf9-1398d78b1705 req-0c72ab81-b939-4af3-9abc-4a5f3846bf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26342276-eba9-44e6-9959-33387a610f2b", "tag": "0b82ba5b-f543-4f90-b789-ad00ac22ad04"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:47:01.635025 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e7e8f53b-53a1-453c-9cf9-1398d78b1705 req-0c72ab81-b939-4af3-9abc-4a5f3846bf9d service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:01.635508 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e7e8f53b-53a1-453c-9cf9-1398d78b1705 req-0c72ab81-b939-4af3-9abc-4a5f3846bf9d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:01.635941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-e7e8f53b-53a1-453c-9cf9-1398d78b1705 req-0c72ab81-b939-4af3-9abc-4a5f3846bf9d service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:01.648029 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-e7e8f53b-53a1-453c-9cf9-1398d78b1705 req-0c72ab81-b939-4af3-9abc-4a5f3846bf9d service nova] Creating event network-changed:0b82ba5b-f543-4f90-b789-ad00ac22ad04 for instance 26342276-eba9-44e6-9959-33387a610f2b on hv-cinder-85226 Aug 08 02:47:01.653815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-e7e8f53b-53a1-453c-9cf9-1398d78b1705 req-0c72ab81-b939-4af3-9abc-4a5f3846bf9d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151184 Aug 08 02:47:01.654736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 551/1109] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:47:27.427178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:47:27.427722 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 02:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:48:16.565031 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:16.565779 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=36 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:16.570230 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:16.570745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:16.577054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:16.577293 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:16.577730 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:16.578466 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:16.578920 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:16.579344 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:16.603097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ca954d83-7b08-435d-b91a-a795103a23f6 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/ips" status: 200 len: 151 microversion: 2.1 time: 0.039925 Aug 08 02:48:16.603659 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 559/1110] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:48:16 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:16.614587 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:16.615372 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=46 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:16.621114 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d92c48-c3d1-44aa-bd32-9c848b858333"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:16.623626 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:16.629761 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:16.630277 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:16.630726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:16.631415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:16.631870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:16.632290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:16.815506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Invalid volume: volume 73d92c48-c3d1-44aa-bd32-9c848b858333 is already attached to instances: f7aefc19-4687-4608-95c1-07161c73b0f0 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: POST /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/os-volume_attachments HTTP/1.1 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 74 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:48:16.817180 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {"volumeAttachment": {"volumeId": "73d92c48-c3d1-44aa-bd32-9c848b858333"}} Aug 08 02:48:16.818919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Invalid volume: volume 73d92c48-c3d1-44aa-bd32-9c848b858333 is already attached to instances: f7aefc19-4687-4608-95c1-07161c73b0f0 Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'server_id': '26342276-eba9-44e6-9959-33387a610f2b', 'body': {'volumeAttachment': {'volumeId': '73d92c48-c3d1-44aa-bd32-9c848b858333'}}} Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73d92c48-c3d1-44aa-bd32-9c848b858333 is already attached to instances: f7aefc19-4687-4608-95c1-07161c73b0f0 Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:16.820182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73d92c48-c3d1-44aa-bd32-9c848b858333 is already attached to instances: f7aefc19-4687-4608-95c1-07161c73b0f0 Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:16.821703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73d92c48-c3d1-44aa-bd32-9c848b858333 is already attached to instances: f7aefc19-4687-4608-95c1-07161c73b0f0 Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 400 to user: Invalid volume: volume 73d92c48-c3d1-44aa-bd32-9c848b858333 is already attached to instances: f7aefc19-4687-4608-95c1-07161c73b0f0 {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1d617607-384a-492f-a458-af8fbe5f6406 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206477 Aug 08 02:48:16.823313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 552/1111] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:48:16 2022] POST /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:48:16.827827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:16.828352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:16.835186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:16.835666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:16.836102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:16.836795 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:16.837247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:16.837672 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:16.865645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:48:17.199546 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b61dc92c-a1cd-400c-a7ab-2a82ab2e16ab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 204 len: 0 microversion: 2.1 time: 0.375154 Aug 08 02:48:17.231340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 560/1112] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:48:16 2022] DELETE /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:48:17.232491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:17.232491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:17.232491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:17.232491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:17.232876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:17.232876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:17.232876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:17.232876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:17.355818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:17.363592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dc590b27-b3a3-4e09-ad0c-4637c3fdd2ff tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1684 microversion: 2.1 time: 0.159075 Aug 08 02:48:17.364169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 553/1113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:17 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:18.386244 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:18.386968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:18.393646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:18.394129 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:18.394611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:18.395306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:18.395764 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:18.396191 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:18.587075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:18.594861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2d80a2eb-7d97-4afa-b660-5d64a817234b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1684 microversion: 2.1 time: 0.213346 Aug 08 02:48:18.595731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 561/1114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:18 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1684 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:19.617059 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:19.617676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:19.624276 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:19.624760 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:19.625196 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:19.625897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:19.626452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:19.626808 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:19.704388 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:19.711997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-badde9a9-48ee-403d-80a5-d0e9e71e64cb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 200 len: 1616 microversion: 2.1 time: 0.098735 Aug 08 02:48:19.717346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 554/1115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:19 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 1616 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:19.770420 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-3ca1041b-aa21-4168-b61b-f59369554bb0 req-846ed1e6-f5ac-411e-87c4-7005360aeabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26342276-eba9-44e6-9959-33387a610f2b", "name": "network-vif-deleted", "tag": "0b82ba5b-f543-4f90-b789-ad00ac22ad04"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:19.782979 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3ca1041b-aa21-4168-b61b-f59369554bb0 req-846ed1e6-f5ac-411e-87c4-7005360aeabe service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:19.783674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3ca1041b-aa21-4168-b61b-f59369554bb0 req-846ed1e6-f5ac-411e-87c4-7005360aeabe service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:19.784281 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3ca1041b-aa21-4168-b61b-f59369554bb0 req-846ed1e6-f5ac-411e-87c4-7005360aeabe service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:19.798426 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-3ca1041b-aa21-4168-b61b-f59369554bb0 req-846ed1e6-f5ac-411e-87c4-7005360aeabe service nova] Creating event network-vif-deleted:0b82ba5b-f543-4f90-b789-ad00ac22ad04 for instance 26342276-eba9-44e6-9959-33387a610f2b on hv-cinder-85226 Aug 08 02:48:19.803892 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-3ca1041b-aa21-4168-b61b-f59369554bb0 req-846ed1e6-f5ac-411e-87c4-7005360aeabe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037659 Aug 08 02:48:19.804496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 562/1116] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:20.733712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:20.735848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:20.741297 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:20.741712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:20.742148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:20.742877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:20.743332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:20.743754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:20.759726 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b HTTP/1.1 Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:48:20.761363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:48:20.771012 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '26342276-eba9-44e6-9959-33387a610f2b'} Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:48:20.771943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:48:20.773279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:48:20.776203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:48:20.776203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-62761beb-53b3-4c98-834f-3c4dd8c3e36f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 404 len: 111 microversion: 2.1 time: 0.033079 Aug 08 02:48:20.776203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 555/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:20 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:48:20.776627 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00479978-c6de-4545-951d-5d6c930fb18e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '.version_select at 0x7fb2bab47160>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:20.875476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-00479978-c6de-4545-951d-5d6c930fb18e tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293216068" status: 202 len: 0 microversion: 2.1 time: 0.107160 Aug 08 02:48:20.876063 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 563/1118] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 02:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293216068 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:48:21.667486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:21.667978 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:21.674009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:21.674529 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:21.674962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:21.675652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:21.676130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:21.676555 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:21.756424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lazy-loading 'services' on Instance uuid f7aefc19-4687-4608-95c1-07161c73b0f0 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:48:21.999095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8a049f1b-a53f-4c27-984a-fe105a7c6aab tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments/73d92c48-c3d1-44aa-bd32-9c848b858333" status: 202 len: 0 microversion: 2.1 time: 0.335875 Aug 08 02:48:21.999688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 556/1119] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:48:21 2022] DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments/73d92c48-c3d1-44aa-bd32-9c848b858333 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:48:22.008866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:22.012185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:22.020154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:22.027319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:22.027319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:22.027319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:22.027319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:22.027804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:22.052141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b7d5903c-6e50-4401-8e03-40a55e9c8a1d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047865 Aug 08 02:48:22.052719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 564/1120] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:48:22 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:23.067860 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:23.070471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:23.078989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:23.079471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:23.079903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:23.080600 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:23.081055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:23.081475 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:23.111733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-dce71a5c-76e4-4241-a470-f01a51ab8dc2 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050269 Aug 08 02:48:23.112556 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 557/1121] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:48:23 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:48:23.185263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:23.185263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:23.185263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:23.185263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:23.186159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:23.186159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:23.186159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:23.186159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:23.210870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:48:23.501615 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0b0524ae-2bc2-44b1-a9a5-e789b5cca646 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 204 len: 0 microversion: 2.1 time: 0.329885 Aug 08 02:48:23.502119 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 565/1122] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:48:23 2022] DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:48:23.512485 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:23.513088 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:23.519130 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:23.519608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:23.520037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:23.520723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:23.521172 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:23.521590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:23.655380 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:23.663761 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-27eb95d4-b7da-48cf-8a55-227cd9dce962 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1682 microversion: 2.1 time: 0.155314 Aug 08 02:48:23.664326 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 558/1123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:23 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:24.685928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:24.686698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:24.693405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:24.693828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:24.694573 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:24.695282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:24.695739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:24.696173 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:24.830697 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:24.838914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-557ba24d-6112-4042-a53f-692a4a72663b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1682 microversion: 2.1 time: 0.156683 Aug 08 02:48:24.839542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 566/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:24 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:25.860269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:25.860901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:25.867303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:25.867836 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:25.868342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:25.869046 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:25.869807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:25.870270 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:26.132413 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:26.140498 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4b16f645-0f84-4dec-be1b-087511f7d9c0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1682 microversion: 2.1 time: 0.284054 Aug 08 02:48:26.141080 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 559/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:25 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:26.309881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-9a6a0d19-b918-45de-bb7f-709ff08e1e21 req-40eacb52-52b5-47a3-8849-8dd428a32903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7aefc19-4687-4608-95c1-07161c73b0f0", "name": "network-vif-deleted", "tag": "b1cd355c-17b9-4b63-9354-70d58ac3d6df"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:26.320075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9a6a0d19-b918-45de-bb7f-709ff08e1e21 req-40eacb52-52b5-47a3-8849-8dd428a32903 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:26.323914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9a6a0d19-b918-45de-bb7f-709ff08e1e21 req-40eacb52-52b5-47a3-8849-8dd428a32903 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:26.323914 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9a6a0d19-b918-45de-bb7f-709ff08e1e21 req-40eacb52-52b5-47a3-8849-8dd428a32903 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:26.336252 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-9a6a0d19-b918-45de-bb7f-709ff08e1e21 req-40eacb52-52b5-47a3-8849-8dd428a32903 service nova] Creating event network-vif-deleted:b1cd355c-17b9-4b63-9354-70d58ac3d6df for instance f7aefc19-4687-4608-95c1-07161c73b0f0 on hv-cinder-85226 Aug 08 02:48:26.342276 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-9a6a0d19-b918-45de-bb7f-709ff08e1e21 req-40eacb52-52b5-47a3-8849-8dd428a32903 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036089 Aug 08 02:48:26.342970 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 567/1126] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:27.161127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:27.162378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:27.169741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:27.170253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:27.170714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:27.171420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:27.171883 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:27.172308 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:27.207127 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:27.207647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:27.208429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:27.209336 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lazy-loading 'fault' on Instance uuid f7aefc19-4687-4608-95c1-07161c73b0f0 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:48:27.255268 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:27.263471 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9d6fe919-dc1f-42f5-8d35-a89b63ff6b46 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 200 len: 1332 microversion: 2.1 time: 0.106272 Aug 08 02:48:27.264072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 560/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:27 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:28.286605 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:28.287246 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:28.293655 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:28.294139 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:28.294612 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:28.295311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:28.295767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:28.296199 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:28.309956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 HTTP/1.1 Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:48:28.311588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:48:28.313222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'f7aefc19-4687-4608-95c1-07161c73b0f0'} Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:48:28.314309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:48:28.315904 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:48:28.317319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:48:28.317319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c33d10c0-5be1-42b5-9946-227bd5f5263f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 404 len: 111 microversion: 2.1 time: 0.031379 Aug 08 02:48:28.317319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 568/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:28 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:48:28.322033 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-369585c6-e202-464e-aeb5-5deb7ad1d5cf tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '.version_select at 0x7fb2ba154940>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:28.393362 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-369585c6-e202-464e-aeb5-5deb7ad1d5cf tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450787217" status: 202 len: 0 microversion: 2.1 time: 0.075375 Aug 08 02:48:28.393927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 561/1129] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 02:48:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450787217 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:48:29.123760 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-146dc5f4-f484-4493-9346-fb35b9ee2ebf tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: .version_select at 0x7fb2ba2b7550>, body: {"keypair": {"name": "tempest-keypair-1860016795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+MnmwIEjzPQ60udg0NP84v4K9kRdLfoNU1HqkeHEHzZL5wE6d9GD7CByAeA6gBh7xexvF4KoK6xq0iBkNvAISXuHrhVrr+QbOBqaGLGuYrZeeL5nY5ilwS4eARqL0XTw=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:29.138932 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-146dc5f4-f484-4493-9346-fb35b9ee2ebf tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:48:29.142713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-146dc5f4-f484-4493-9346-fb35b9ee2ebf tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:48:29.245872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-146dc5f4-f484-4493-9346-fb35b9ee2ebf tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126724 Aug 08 02:48:29.246482 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 569/1130] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:48:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:31.452452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-850001376", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87421ac7-3501-495d-abd1-cf8008d9c1cb"}], "security_groups": [{"name": "tempest-securitygroup--1546831041"}], "key_name": "tempest-keypair-1860016795", "user_data": "}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:31.554165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] validate_networks() for [('87421ac7-3501-495d-abd1-cf8008d9c1cb', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:48:32.164285 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:48:32.164735 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:48:32.165216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:48:32.165692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:48:32.166133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:48:32.175166 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:32.175654 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:32.176086 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:32.176810 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:32.177268 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:32.177691 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:32.194640 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:48:32.199331 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:48:32.210546 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:48:32.213369 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:48:32.338653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-620214b4-b926-4ec7-99a4-6a956996cd52 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.890995 Aug 08 02:48:32.339816 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 562/1131] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:48:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:48:32.351411 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-813d90bb-fa61-4d1a-bdac-e01ed672762b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:32.352022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-813d90bb-fa61-4d1a-bdac-e01ed672762b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:32.410890 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-813d90bb-fa61-4d1a-bdac-e01ed672762b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:32.418727 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-813d90bb-fa61-4d1a-bdac-e01ed672762b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1241 microversion: 2.1 time: 0.071631 Aug 08 02:48:32.419284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 570/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:32 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:33.440135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:33.440747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:33.448226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:33.448708 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:33.449138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:33.449830 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:33.450279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:33.450724 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:33.516383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:33.524099 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0b6562ab-c74c-4cdf-9a77-35cc560757ad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1245 microversion: 2.1 time: 0.088282 Aug 08 02:48:33.524681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 563/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:33 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:48:34.545011 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:34.545685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:34.552296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:34.552786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:34.553519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:34.554236 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:34.554769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:34.555201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:34.629856 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:34.641256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5e892bde-50a5-4abd-95b5-f26df0808334 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1299 microversion: 2.1 time: 0.100400 Aug 08 02:48:34.641887 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 571/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:34 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:35.662929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:35.663545 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:35.670607 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:35.671096 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:35.671530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:35.672228 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:35.672683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:35.673106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:35.838564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:35.846003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-bd411007-423f-4dfa-a012-f7eecce02fad tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.187028 Aug 08 02:48:35.846610 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 564/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:35 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:35.894917 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-1b9c12ef-cadf-476a-be51-fd257a0d6e13 req-d97fac1d-4ba3-444c-913e-71091b5d422e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee616f3-b833-4fbe-8f08-5a4b312c3948", "tag": "e3adce21-4464-4515-8eb3-cdf7e8e7791a"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:35.905073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-1b9c12ef-cadf-476a-be51-fd257a0d6e13 req-d97fac1d-4ba3-444c-913e-71091b5d422e service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:35.905767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-1b9c12ef-cadf-476a-be51-fd257a0d6e13 req-d97fac1d-4ba3-444c-913e-71091b5d422e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:35.906195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-1b9c12ef-cadf-476a-be51-fd257a0d6e13 req-d97fac1d-4ba3-444c-913e-71091b5d422e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:35.918340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-1b9c12ef-cadf-476a-be51-fd257a0d6e13 req-d97fac1d-4ba3-444c-913e-71091b5d422e service nova] Creating event network-changed:e3adce21-4464-4515-8eb3-cdf7e8e7791a for instance dee616f3-b833-4fbe-8f08-5a4b312c3948 on hv-cinder-85226 Aug 08 02:48:35.923945 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-1b9c12ef-cadf-476a-be51-fd257a0d6e13 req-d97fac1d-4ba3-444c-913e-71091b5d422e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032440 Aug 08 02:48:35.924695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 572/1136] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:48:36.867255 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:36.867777 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:36.874229 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:36.874743 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:36.875179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:36.875867 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:36.876322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:36.876750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:37.014341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:37.021729 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3ea3e780-e84b-4541-bc44-c70b3387dd87 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.158442 Aug 08 02:48:37.022298 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 565/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:36 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:38.043462 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:38.044156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:38.050733 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:38.051210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:38.051645 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:38.052373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:38.052831 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:38.053253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:38.183159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:38.190686 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b4ce0321-f423-44dd-b1e7-e85391624c88 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.152001 Aug 08 02:48:38.191261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 573/1138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:38 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:39.211914 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:39.213027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:39.219440 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:39.219919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:39.220350 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:39.221035 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:39.221488 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:39.221911 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:39.364551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:39.372695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0ae7ef3d-5f97-49ee-af0f-c51c283d0a8c tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.164635 Aug 08 02:48:39.373474 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 566/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:39 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:40.395408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:40.396165 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:40.403200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:40.403684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:40.408869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:40.408869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:40.408869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:40.408869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:40.540855 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:40.548337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b88ff48b-3441-4916-bb73-fab85e85463f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.158224 Aug 08 02:48:40.548906 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 574/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:40 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:41.569549 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:41.570154 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:41.577320 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:41.577796 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:41.578226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:41.578945 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:41.579398 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:41.579821 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:41.711495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:41.719247 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b08927a4-560e-4653-8742-8cfc12d538bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.153709 Aug 08 02:48:41.719828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 567/1141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:41 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:41.945380 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-0094410a-264c-4f1d-886a-15c0e0b8505d req-8bd315c0-4a69-4dc6-96bd-90ca5871c95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee616f3-b833-4fbe-8f08-5a4b312c3948", "name": "network-vif-plugged", "status": "completed", "tag": "e3adce21-4464-4515-8eb3-cdf7e8e7791a"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:41.956019 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-0094410a-264c-4f1d-886a-15c0e0b8505d req-8bd315c0-4a69-4dc6-96bd-90ca5871c95a service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:41.956495 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-0094410a-264c-4f1d-886a-15c0e0b8505d req-8bd315c0-4a69-4dc6-96bd-90ca5871c95a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:41.956949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-0094410a-264c-4f1d-886a-15c0e0b8505d req-8bd315c0-4a69-4dc6-96bd-90ca5871c95a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:41.968068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-0094410a-264c-4f1d-886a-15c0e0b8505d req-8bd315c0-4a69-4dc6-96bd-90ca5871c95a service nova] Creating event network-vif-plugged:e3adce21-4464-4515-8eb3-cdf7e8e7791a for instance dee616f3-b833-4fbe-8f08-5a4b312c3948 on hv-cinder-85226 Aug 08 02:48:41.973026 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-0094410a-264c-4f1d-886a-15c0e0b8505d req-8bd315c0-4a69-4dc6-96bd-90ca5871c95a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031561 Aug 08 02:48:41.973617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 575/1142] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:42.740431 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:42.741028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:42.742996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:42.743696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:42.748881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:42.755996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:42.755996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:42.755996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:42.755996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:42.756388 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:42.885327 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:42.892837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-948e9362-a0a7-4c08-a8a4-a1510313baeb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.156275 Aug 08 02:48:42.893631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 568/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:42 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:43.911394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:43.916201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:43.916918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:43.923238 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:43.923719 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:43.924159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:43.924859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:43.925311 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:43.925739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:44.070163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:44.078632 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-90f4da1d-689c-4e2e-ae8c-26c6d825e409 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1367 microversion: 2.1 time: 0.168107 Aug 08 02:48:44.080538 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 576/1144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:43 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:45.099208 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:45.099844 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:45.106848 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:45.107332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:45.107767 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:45.108462 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:45.108915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:45.109341 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:45.245207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:48:45.248636 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:48:45.252973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9e08e137-4c34-4327-9657-14d95ec9a5ea tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1557 microversion: 2.1 time: 0.157658 Aug 08 02:48:45.253543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 569/1145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:48:45 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:45.273745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:48:45.274278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:48:45.281159 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:45.281644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:45.282087 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:45.282827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:45.283284 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:45.283714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:45.362910 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5311d541-5c95-46c0-9ab2-eae0e8026871 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092935 Aug 08 02:48:45.363515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 577/1146] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:48:45 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:48:46.571749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-4e05008b-3f3f-4385-98f9-0baa532035cf req-6c6f1a97-c05d-481c-9005-5f482bba9e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee616f3-b833-4fbe-8f08-5a4b312c3948", "tag": "e3adce21-4464-4515-8eb3-cdf7e8e7791a"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:48:46.582187 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4e05008b-3f3f-4385-98f9-0baa532035cf req-6c6f1a97-c05d-481c-9005-5f482bba9e62 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:48:46.582696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4e05008b-3f3f-4385-98f9-0baa532035cf req-6c6f1a97-c05d-481c-9005-5f482bba9e62 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:48:46.583128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4e05008b-3f3f-4385-98f9-0baa532035cf req-6c6f1a97-c05d-481c-9005-5f482bba9e62 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:48:46.594883 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-4e05008b-3f3f-4385-98f9-0baa532035cf req-6c6f1a97-c05d-481c-9005-5f482bba9e62 service nova] Creating event network-changed:e3adce21-4464-4515-8eb3-cdf7e8e7791a for instance dee616f3-b833-4fbe-8f08-5a4b312c3948 on hv-cinder-85226 Aug 08 02:48:46.600337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-4e05008b-3f3f-4385-98f9-0baa532035cf req-6c6f1a97-c05d-481c-9005-5f482bba9e62 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032636 Aug 08 02:48:46.601117 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 570/1147] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:49:51.349386 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:51.350147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:51.411478 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:51.411478 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:51.416595 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:51.417078 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:51.417518 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:51.418228 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:51.418702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:51.419131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:51.442635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b745a988-fd88-4434-885a-019b0c7b411a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/ips" status: 200 len: 150 microversion: 2.1 time: 0.094851 Aug 08 02:49:51.445569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 578/1148] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:49:51 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:49:53.064377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:53.069791 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90d6347f-9557-4deb-92bc-8d1b381f818d"}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:49:53.072261 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:53.078423 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:53.078900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:53.079328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:53.080009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:53.080512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:53.080928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:53.744714 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-643cd15d-b881-4492-92e8-365194f3e6b1 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681509 Aug 08 02:49:53.745390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 571/1149] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:49:53 2022] POST /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:01.257116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90d6347f-9557-4deb-92bc-8d1b381f818d"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:01.259737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:01.267749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:01.268221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:01.268657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:01.269432 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:01.269771 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:01.270190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:01.347897 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Invalid volume: volume 90d6347f-9557-4deb-92bc-8d1b381f818d is already attached to instances: dee616f3-b833-4fbe-8f08-5a4b312c3948 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: POST /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments HTTP/1.1 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 74 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:50:01.349684 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {"volumeAttachment": {"volumeId": "90d6347f-9557-4deb-92bc-8d1b381f818d"}} Aug 08 02:50:01.351484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Invalid volume: volume 90d6347f-9557-4deb-92bc-8d1b381f818d is already attached to instances: dee616f3-b833-4fbe-8f08-5a4b312c3948 Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'server_id': 'dee616f3-b833-4fbe-8f08-5a4b312c3948', 'body': {'volumeAttachment': {'volumeId': '90d6347f-9557-4deb-92bc-8d1b381f818d'}}} Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 90d6347f-9557-4deb-92bc-8d1b381f818d is already attached to instances: dee616f3-b833-4fbe-8f08-5a4b312c3948 Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:01.352439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 90d6347f-9557-4deb-92bc-8d1b381f818d is already attached to instances: dee616f3-b833-4fbe-8f08-5a4b312c3948 Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:50:01.353962 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 90d6347f-9557-4deb-92bc-8d1b381f818d is already attached to instances: dee616f3-b833-4fbe-8f08-5a4b312c3948 Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 400 to user: Invalid volume: volume 90d6347f-9557-4deb-92bc-8d1b381f818d is already attached to instances: dee616f3-b833-4fbe-8f08-5a4b312c3948 {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-efa4bf7f-c4ce-46ee-ba9d-23cb4ebf401a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098435 Aug 08 02:50:01.355569 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 579/1150] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:50:01 2022] POST /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 02:50:01.416470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:01.417040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:01.423126 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:01.423599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:01.424027 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:01.424705 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:01.425156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:01.425572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:01.504486 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lazy-loading 'services' on Instance uuid dee616f3-b833-4fbe-8f08-5a4b312c3948 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:50:01.720893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0049cf00-065d-4e8a-b171-1206c009d3ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments/90d6347f-9557-4deb-92bc-8d1b381f818d" status: 202 len: 0 microversion: 2.1 time: 0.308932 Aug 08 02:50:01.721647 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 572/1151] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:50:01 2022] DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments/90d6347f-9557-4deb-92bc-8d1b381f818d => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:50:01.729958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:01.732300 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:01.739498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:01.739973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:01.740408 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:01.741104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:01.741551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:01.741973 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:01.771027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a00a166c-ebe7-4988-afba-7d0bfb5a1c05 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Aug 08 02:50:01.771575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 580/1152] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:50:01 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:02.784502 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:02.786679 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:02.794342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:02.794831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:02.795254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:02.795936 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:02.796384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:02.796801 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:02.826722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ce5c541f-de7a-48bd-a6bf-d554ff5e07ae tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046708 Aug 08 02:50:02.827280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 573/1153] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:50:02 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:50:02.887586 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:02.888084 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:02.894390 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:02.894872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:02.895308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:02.896001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:02.896453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:02.896879 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:02.921949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:50:03.203302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1e9a54e5-bb74-4c44-99b1-ba16d3ff1210 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 204 len: 0 microversion: 2.1 time: 0.319732 Aug 08 02:50:03.203888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 581/1154] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:50:02 2022] DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:50:03.211991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:03.215158 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:03.218880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:03.219363 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:03.219794 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:03.220476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:03.220929 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:03.221348 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:03.348288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:03.355818 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1ee701e1-2003-4e13-bf88-72ea9654e015 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1682 microversion: 2.1 time: 0.147688 Aug 08 02:50:03.356374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 574/1155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:03 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:04.378934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:04.379630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:04.386551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:04.387030 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:04.387467 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:04.388156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:04.388607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:04.389033 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:04.522081 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:04.530344 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a2257cad-98ae-4065-8cd6-cd721c6178bb tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1682 microversion: 2.1 time: 0.155705 Aug 08 02:50:04.530935 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 582/1156] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:04 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:05.551561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:05.552267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:05.559047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:05.559556 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:05.559988 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:05.560676 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:05.561178 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:05.561543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:05.721684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:05.729296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-80a3a7ff-5a24-430a-9ca3-06e985584242 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1682 microversion: 2.1 time: 0.181534 Aug 08 02:50:05.730067 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 575/1157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:05 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:06.113309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-36161c8b-97cc-43b7-a380-6892e41badda req-ff5baf9b-0a62-455c-ac41-d5a57922469f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee616f3-b833-4fbe-8f08-5a4b312c3948", "name": "network-vif-deleted", "tag": "e3adce21-4464-4515-8eb3-cdf7e8e7791a"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:06.131445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-36161c8b-97cc-43b7-a380-6892e41badda req-ff5baf9b-0a62-455c-ac41-d5a57922469f service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:06.138542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-36161c8b-97cc-43b7-a380-6892e41badda req-ff5baf9b-0a62-455c-ac41-d5a57922469f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:06.138542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-36161c8b-97cc-43b7-a380-6892e41badda req-ff5baf9b-0a62-455c-ac41-d5a57922469f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:06.146273 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-36161c8b-97cc-43b7-a380-6892e41badda req-ff5baf9b-0a62-455c-ac41-d5a57922469f service nova] Creating event network-vif-deleted:e3adce21-4464-4515-8eb3-cdf7e8e7791a for instance dee616f3-b833-4fbe-8f08-5a4b312c3948 on hv-cinder-85226 Aug 08 02:50:06.152395 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-36161c8b-97cc-43b7-a380-6892e41badda req-ff5baf9b-0a62-455c-ac41-d5a57922469f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109249 Aug 08 02:50:06.153581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 583/1158] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:06.751723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:06.752866 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:06.759512 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:06.760057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:06.760476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:06.761649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:06.762133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:06.762588 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:06.797158 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:06.797695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:06.798131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:06.798602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lazy-loading 'fault' on Instance uuid dee616f3-b833-4fbe-8f08-5a4b312c3948 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:50:07.094819 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:07.101880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b99163d1-4452-4987-81cd-c56e7c235f65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 200 len: 1331 microversion: 2.1 time: 0.353915 Aug 08 02:50:07.102837 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 576/1159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:06 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 1331 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:08.124894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:08.125590 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:08.131706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:08.132180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:08.132617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:08.133306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:08.133761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:08.134185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:08.149185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 HTTP/1.1 Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:50:08.150828 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:50:08.152576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'dee616f3-b833-4fbe-8f08-5a4b312c3948'} Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:50:08.153699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:50:08.155312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:50:08.156824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:50:08.156824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-162bdf4d-38e6-48bf-9019-29b65e38d6fc tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 404 len: 111 microversion: 2.1 time: 0.032640 Aug 08 02:50:08.156824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 584/1160] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:08 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:50:08.160999 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e8bc6d68-a67e-44c8-a14d-f628aad02716 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '.version_select at 0x7fb2b9f60670>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:08.238120 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e8bc6d68-a67e-44c8-a14d-f628aad02716 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860016795" status: 202 len: 0 microversion: 2.1 time: 0.080814 Aug 08 02:50:08.238642 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 577/1161] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 02:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860016795 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:50:08.982010 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d010bbaa-c27b-4a87-b116-8d5c470f0e7f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: .version_select at 0x7fb2bab35b80>, body: {"keypair": {"name": "tempest-keypair-283382246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT4hl8LLw0Iyc+hDXLTvnCgWsE2sQhFfMgGK+gMG7zjUgcjivLVbd03JqqG7Y5SZ7KRwPHHHtLAB2g5GGtpRVXSZu+tnhNheP64t2dd58VMolbLYap4ouhL/SStM590FQ=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:08.997419 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-d010bbaa-c27b-4a87-b116-8d5c470f0e7f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:50:09.001185 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-d010bbaa-c27b-4a87-b116-8d5c470f0e7f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:50:09.077061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d010bbaa-c27b-4a87-b116-8d5c470f0e7f tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098896 Aug 08 02:50:09.077654 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 585/1162] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:50:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:11.275431 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1660715175", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87421ac7-3501-495d-abd1-cf8008d9c1cb"}], "security_groups": [{"name": "tempest-securitygroup--160199729"}], "key_name": "tempest-keypair-283382246", "user_data": "}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:11.382091 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] validate_networks() for [('87421ac7-3501-495d-abd1-cf8008d9c1cb', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:50:11.741048 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:50:11.741507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:50:11.741979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:50:11.742409 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:50:11.742824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:50:11.752406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:11.752883 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:11.753322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:11.754054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:11.754543 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:11.754967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:11.775903 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:50:11.779962 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Getting quotas for user f3a60f8c44524cc4a7a394060e619b9d and project 570f253b2653418dabc6566536e14353. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:50:11.790991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:50:11.795663 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:50:11.913481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1efc1a41-0e51-4277-b385-2c53c9eed745 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.642737 Aug 08 02:50:11.914263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 578/1163] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:50:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:50:11.926590 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-feed6707-89e6-4e7d-86b3-cf3612f581e8 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:11.931205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-feed6707-89e6-4e7d-86b3-cf3612f581e8 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:11.990366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-feed6707-89e6-4e7d-86b3-cf3612f581e8 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:11.998761 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-feed6707-89e6-4e7d-86b3-cf3612f581e8 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1241 microversion: 2.1 time: 0.076617 Aug 08 02:50:11.999317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 586/1164] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:11 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:13.019814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:13.020461 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:13.027346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:13.027827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:13.028263 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:13.028953 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:13.029412 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:13.029839 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:13.091846 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:13.099269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-35f68769-866f-4def-a116-b10606350931 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1237 microversion: 2.1 time: 0.083966 Aug 08 02:50:13.099838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 579/1165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:13 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:14.120271 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:14.121712 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:14.128175 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:14.128648 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:14.129086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:14.129817 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:14.130296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:14.130872 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:14.193607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:14.201219 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c8bc6cb4-1558-4c51-9707-7cb63df912e5 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1299 microversion: 2.1 time: 0.084881 Aug 08 02:50:14.201800 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 587/1166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:14 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:15.222547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:15.223159 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:15.229536 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:15.230014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:15.230507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:15.231316 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:15.231775 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:15.232197 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:15.398410 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-dbe2e18a-8980-49cf-b33e-1bb68320e77c req-d3f5af49-a060-408e-83ab-37413ca285ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340d14b1-b759-4dfb-916d-0de53c87cfe3", "tag": "610cc3cc-a3bb-4f81-b89b-f4027f02aef9"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:15.406621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:15.409407 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dbe2e18a-8980-49cf-b33e-1bb68320e77c req-d3f5af49-a060-408e-83ab-37413ca285ad service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:15.409913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dbe2e18a-8980-49cf-b33e-1bb68320e77c req-d3f5af49-a060-408e-83ab-37413ca285ad service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:15.410378 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dbe2e18a-8980-49cf-b33e-1bb68320e77c req-d3f5af49-a060-408e-83ab-37413ca285ad service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:15.414608 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-97b37aad-ac99-4b4b-bbd8-2a5a0beeb773 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.195734 Aug 08 02:50:15.415281 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 580/1167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:15 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:15.421568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-dbe2e18a-8980-49cf-b33e-1bb68320e77c req-d3f5af49-a060-408e-83ab-37413ca285ad service nova] Creating event network-changed:610cc3cc-a3bb-4f81-b89b-f4027f02aef9 for instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 on hv-cinder-85226 Aug 08 02:50:15.428585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-dbe2e18a-8980-49cf-b33e-1bb68320e77c req-d3f5af49-a060-408e-83ab-37413ca285ad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033843 Aug 08 02:50:15.429242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 588/1168] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:50:16.436312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:16.436921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:16.443538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:16.444016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:16.444451 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:16.445137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:16.445591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:16.446017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:16.573210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:16.582040 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-35c96f55-4881-4ce3-a1dd-2aa9e2965cd4 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.149631 Aug 08 02:50:16.582640 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 581/1169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:16 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:17.603824 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:17.604520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:17.611502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:17.611980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:17.612417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:17.613104 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:17.613556 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:17.613985 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:17.739366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:17.746859 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ddd7195f-19ee-4006-9172-a97b6215d979 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.147794 Aug 08 02:50:17.747439 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 589/1170] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:17 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:18.767432 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:18.768020 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:18.774435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:18.774912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:18.775355 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:18.776018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:18.776466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:18.776882 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:18.906146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:18.913475 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4e354a6a-fe7b-4e3a-9989-23eaea8fedba tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.149871 Aug 08 02:50:18.914038 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 582/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:18 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:19.934588 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:19.935202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:19.941841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:19.942317 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:19.942774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:19.943460 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:19.943915 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:19.944342 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:20.076059 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:20.083626 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-06f523dd-b5b0-48e6-b16a-41abc90c3436 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.153466 Aug 08 02:50:20.084186 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 590/1172] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:19 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:21.103191 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:21.103725 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:21.110279 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:21.110781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:21.111206 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:21.111891 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:21.112339 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:21.112757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:21.242733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:21.250635 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e52573fc-3ffc-438d-b90a-5c28ad713a79 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.151376 Aug 08 02:50:21.251193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 583/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:21 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:22.272366 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:22.272891 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:22.275326 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:50:22.280994 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:22.282954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:22.282954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:22.282954 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:22.283248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:22.283452 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:22.414140 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:22.422013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9e1458fd-5299-481f-8e83-d8b35881f99a tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.153592 Aug 08 02:50:22.422818 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 591/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:22 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:22.512003 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:50:22.512880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:50:22.586881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-8fd0d2aa-7dbe-4090-8e64-af33e68a5cb4 req-26b234da-18b8-4bde-9c06-3c7d9c4421ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340d14b1-b759-4dfb-916d-0de53c87cfe3", "name": "network-vif-plugged", "status": "completed", "tag": "610cc3cc-a3bb-4f81-b89b-f4027f02aef9"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:22.596415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-8fd0d2aa-7dbe-4090-8e64-af33e68a5cb4 req-26b234da-18b8-4bde-9c06-3c7d9c4421ac service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:22.598016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-8fd0d2aa-7dbe-4090-8e64-af33e68a5cb4 req-26b234da-18b8-4bde-9c06-3c7d9c4421ac service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:22.598016 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-8fd0d2aa-7dbe-4090-8e64-af33e68a5cb4 req-26b234da-18b8-4bde-9c06-3c7d9c4421ac service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:22.610435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-8fd0d2aa-7dbe-4090-8e64-af33e68a5cb4 req-26b234da-18b8-4bde-9c06-3c7d9c4421ac service nova] Creating event network-vif-plugged:610cc3cc-a3bb-4f81-b89b-f4027f02aef9 for instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 on hv-cinder-85226 Aug 08 02:50:22.615424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-8fd0d2aa-7dbe-4090-8e64-af33e68a5cb4 req-26b234da-18b8-4bde-9c06-3c7d9c4421ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108467 Aug 08 02:50:22.616359 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 584/1175] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:23.443108 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:23.443739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:23.450202 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:23.450712 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:23.451147 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:23.451830 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:23.452279 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:23.452698 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:23.582046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:23.589387 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ed7073df-be25-4baa-a81f-d6872b7beb66 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.150379 Aug 08 02:50:23.589986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 592/1176] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:23 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:24.611410 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:24.612142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:24.614430 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:50:24.619477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:24.619950 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:24.620376 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:24.621052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:24.621547 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:24.622776 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:24.627007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:50:24.761330 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:24.768921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9ae37763-a43d-4b07-b4a3-1e36987ea103 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1366 microversion: 2.1 time: 0.162956 Aug 08 02:50:24.769478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 585/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:24 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:25.789889 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:25.792389 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:25.796919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:25.797397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:25.797833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:25.798702 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:25.799152 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:25.799575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:25.929593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:50:25.937786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-50782285-16ba-4f50-a41f-70d6df1d7115 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1557 microversion: 2.1 time: 0.151707 Aug 08 02:50:25.938371 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 593/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:50:25 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:50:25.958535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:50:25.959065 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:50:25.966541 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:25.969863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:25.969863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:25.969863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:25.969863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:25.970246 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:26.048581 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-7c6a097e-d05b-44e3-8b71-b1e10b601900 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094235 Aug 08 02:50:26.049179 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 586/1179] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 02:50:25 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:27.006397 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b28debb8-aa5b-432b-ac0b-64b2233a0d56 req-60201828-9339-4926-acf2-40873c95092b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340d14b1-b759-4dfb-916d-0de53c87cfe3", "tag": "610cc3cc-a3bb-4f81-b89b-f4027f02aef9"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:50:27.016069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b28debb8-aa5b-432b-ac0b-64b2233a0d56 req-60201828-9339-4926-acf2-40873c95092b service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:50:27.016545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b28debb8-aa5b-432b-ac0b-64b2233a0d56 req-60201828-9339-4926-acf2-40873c95092b service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:50:27.016979 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b28debb8-aa5b-432b-ac0b-64b2233a0d56 req-60201828-9339-4926-acf2-40873c95092b service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:50:27.027991 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-b28debb8-aa5b-432b-ac0b-64b2233a0d56 req-60201828-9339-4926-acf2-40873c95092b service nova] Creating event network-changed:610cc3cc-a3bb-4f81-b89b-f4027f02aef9 for instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 on hv-cinder-85226 Aug 08 02:50:27.033762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b28debb8-aa5b-432b-ac0b-64b2233a0d56 req-60201828-9339-4926-acf2-40873c95092b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Aug 08 02:50:27.034372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 594/1180] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:50:47.435484 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:50:47.436180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 02:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:51:31.836605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=9 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:51:31.837353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:51:31.841511 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:31.842000 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:31.848457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:31.848942 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:31.849378 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:31.850063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:31.850544 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:31.850969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:31.874420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-24d46e28-26d8-490b-87b8-d329d2821b23 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/ips" status: 200 len: 150 microversion: 2.1 time: 0.039598 Aug 08 02:51:31.874990 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 587/1181] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 02:51:31 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:51:33.506523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:51:33.507265 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:51:33.511783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7a45b2f-bbd4-46d3-b810-03fc1c264caf"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:51:33.514217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:33.521127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:33.521604 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:33.522042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:33.522767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:33.523222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:33.523644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:34.194866 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5f34576e-be10-48ef-aa16-4a078c7c0703 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "POST /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690017 Aug 08 02:51:34.195506 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 595/1182] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 02:51:33 2022] POST /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:51:41.803353 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:41.803861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:41.811036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:41.811514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:41.811947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:41.812634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:41.813318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:41.813747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:41.892495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lazy-loading 'services' on Instance uuid 340d14b1-b759-4dfb-916d-0de53c87cfe3 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:51:42.146932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-78c6cee8-9b0e-4ad4-b4d4-a4db4536a950 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments/b7a45b2f-bbd4-46d3-b810-03fc1c264caf" status: 202 len: 0 microversion: 2.1 time: 0.347229 Aug 08 02:51:42.147715 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 588/1183] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 02:51:41 2022] DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments/b7a45b2f-bbd4-46d3-b810-03fc1c264caf => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:51:42.158039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:42.160389 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:42.166483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:42.166968 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:42.167405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:42.168103 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:42.168554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:42.168978 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:42.199292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d44ffef8-d22e-41b3-b089-20cdca886474 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046113 Aug 08 02:51:42.199845 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 596/1184] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:51:42 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:51:43.212128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:43.214501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:43.221601 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:43.222087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:43.222563 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:43.223252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:43.223707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:43.224132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:43.252901 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-5b705b46-91bc-498f-b9b3-8e2cc665bf4d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045159 Aug 08 02:51:43.253449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 589/1185] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 02:51:43 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:51:43.313283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:43.313822 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:43.320427 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:43.320902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:43.321335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:43.322018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:43.322524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:43.322901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:43.347864 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:51:43.610419 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0b94fa59-8f60-4f89-a5f6-6ba9a37a67dd tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 204 len: 0 microversion: 2.1 time: 0.300604 Aug 08 02:51:43.611021 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 597/1186] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:51:43 2022] DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:51:43.624657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:43.625503 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:43.631489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:43.631983 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:43.632419 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:43.633116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:43.633575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:43.633997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:43.770997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:51:43.778694 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3aa5102f-5318-4935-b33d-6268bfbdd57b tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1681 microversion: 2.1 time: 0.157898 Aug 08 02:51:43.779252 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 590/1187] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:43 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:51:44.801069 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:44.801767 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:44.808161 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:44.808636 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:44.809065 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:44.809742 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:44.810187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:44.810630 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:44.948066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:51:44.956150 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c5ab5a8b-557a-4284-822f-d2879df88d86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1681 microversion: 2.1 time: 0.160170 Aug 08 02:51:44.956706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 598/1188] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:44 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:51:45.977592 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:45.978199 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:45.984367 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:45.984835 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:45.986173 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:45.986530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:45.986980 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:45.987401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:46.464912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:51:46.472992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ebeffa37-c9ac-41cc-9250-0c394005363d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1681 microversion: 2.1 time: 0.499227 Aug 08 02:51:46.473562 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 591/1189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:45 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1681 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:51:46.646169 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-20637990-ec8d-45a4-8c5f-16a3d7bfdea8 req-5e29816c-6cd9-49cf-a5d0-730b3343ab8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340d14b1-b759-4dfb-916d-0de53c87cfe3", "name": "network-vif-deleted", "tag": "610cc3cc-a3bb-4f81-b89b-f4027f02aef9"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:51:46.655515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-20637990-ec8d-45a4-8c5f-16a3d7bfdea8 req-5e29816c-6cd9-49cf-a5d0-730b3343ab8a service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:46.655980 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-20637990-ec8d-45a4-8c5f-16a3d7bfdea8 req-5e29816c-6cd9-49cf-a5d0-730b3343ab8a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:46.656415 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-20637990-ec8d-45a4-8c5f-16a3d7bfdea8 req-5e29816c-6cd9-49cf-a5d0-730b3343ab8a service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:46.669382 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-20637990-ec8d-45a4-8c5f-16a3d7bfdea8 req-5e29816c-6cd9-49cf-a5d0-730b3343ab8a service nova] Creating event network-vif-deleted:610cc3cc-a3bb-4f81-b89b-f4027f02aef9 for instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 on hv-cinder-85226 Aug 08 02:51:46.674874 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-20637990-ec8d-45a4-8c5f-16a3d7bfdea8 req-5e29816c-6cd9-49cf-a5d0-730b3343ab8a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032725 Aug 08 02:51:46.675518 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 599/1190] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:51:47.493204 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:47.493854 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:47.502669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:47.502669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:47.502669 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:47.503052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:47.503493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:47.503915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:47.541513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:47.541993 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:47.542442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:47.542894 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.objects.instance [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lazy-loading 'fault' on Instance uuid 340d14b1-b759-4dfb-916d-0de53c87cfe3 {{(pid=124658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:51:47.586939 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a60f8c44524cc4a7a394060e619b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '570f253b2653418dabc6566536e14353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:51:47.594149 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-d8261f10-84fa-4125-bd26-77f73a7921ef tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 200 len: 1331 microversion: 2.1 time: 0.104764 Aug 08 02:51:47.594758 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 592/1191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:47 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:51:48.621984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:48.622724 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:48.629432 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:48.629902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:48.630339 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:48.631049 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:48.631496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:48.631918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:48.644756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 HTTP/1.1 Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:51:48.646368 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:48.648066 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '340d14b1-b759-4dfb-916d-0de53c87cfe3'} Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:48.649176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:48.650834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:48.652352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:48.652352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8cd4702b-acbc-4863-89f9-fcf82ee3be86 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 404 len: 111 microversion: 2.1 time: 0.030391 Aug 08 02:51:48.652352 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 600/1192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:48 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:51:48.656415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-de86732c-d45f-4f87-aeae-b8692b421c51 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '.version_select at 0x7fb2ba25a700>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:48.744857 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-de86732c-d45f-4f87-aeae-b8692b421c51 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283382246" status: 202 len: 0 microversion: 2.1 time: 0.092095 Aug 08 02:51:48.745456 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 593/1193] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 02:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283382246 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:51:50.710476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:50.710985 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:50.717301 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:50.717780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:50.718210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:50.718924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:50.719374 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:50.719803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:50.733068 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 HTTP/1.1 Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:51:50.734640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.736810 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '340d14b1-b759-4dfb-916d-0de53c87cfe3'} Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:50.737647 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.738997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.740562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:50.740562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-42552edf-48c7-4b1d-8ccf-d520788eab65 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 404 len: 111 microversion: 2.1 time: 0.029498 Aug 08 02:51:50.740562 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 601/1194] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:51:50 2022] DELETE /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:51:50.745291 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:50.745933 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 340d14b1-b759-4dfb-916d-0de53c87cfe3] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:50.753402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:50.753878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:50.754313 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:50.755028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:50.755485 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:50.755905 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:50.769650 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 HTTP/1.1 Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:51:50.771329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.772924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '340d14b1-b759-4dfb-916d-0de53c87cfe3'} Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:50.773850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. Aug 08 02:51:50.775535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:50.776833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance 340d14b1-b759-4dfb-916d-0de53c87cfe3 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:50.776833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-166f30a0-ccdf-437f-99dd-6a66b6a2c120 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3" status: 404 len: 111 microversion: 2.1 time: 0.031752 Aug 08 02:51:50.776833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 594/1195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:50 2022] GET /compute/v2.1/servers/340d14b1-b759-4dfb-916d-0de53c87cfe3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:51:52.053181 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:52.053690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:52.060190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.060669 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.061102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.061826 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.062274 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.062718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.077146 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 HTTP/1.1 Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:51:52.078695 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.081043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'dee616f3-b833-4fbe-8f08-5a4b312c3948'} Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:52.081987 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.083548 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.085203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:52.085203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-30477689-b12c-4525-b57d-6b465cc897a0 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 404 len: 111 microversion: 2.1 time: 0.031523 Aug 08 02:51:52.085203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 602/1196] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:51:52 2022] DELETE /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:51:52.089239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:52.089851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: dee616f3-b833-4fbe-8f08-5a4b312c3948] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:52.096790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.097264 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.097696 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.098398 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.098853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.099272 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.112976 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 HTTP/1.1 Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:51:52.114518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.116095 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'dee616f3-b833-4fbe-8f08-5a4b312c3948'} Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:52.116989 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. Aug 08 02:51:52.118672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.119938 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance dee616f3-b833-4fbe-8f08-5a4b312c3948 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:52.119938 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fb40364e-4ee8-4d53-8ad6-d34cbf4a0c81 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948" status: 404 len: 111 microversion: 2.1 time: 0.030410 Aug 08 02:51:52.119938 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 595/1197] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:52 2022] GET /compute/v2.1/servers/dee616f3-b833-4fbe-8f08-5a4b312c3948 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:51:52.124133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:52.124642 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:52.131296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.131765 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.132195 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.132873 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.133322 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.133746 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.147532 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b HTTP/1.1 Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:51:52.149028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.150796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '26342276-eba9-44e6-9959-33387a610f2b'} Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:52.151690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.153155 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.154762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:52.154762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-818e8c84-614a-4caa-a0c9-39663564282d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 404 len: 111 microversion: 2.1 time: 0.030006 Aug 08 02:51:52.154762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 603/1198] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:51:52 2022] DELETE /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:51:52.158943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:52.159583 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: 26342276-eba9-44e6-9959-33387a610f2b] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:52.165513 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.165996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.166454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.167151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:52.167603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:52.168028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:52.181385 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b HTTP/1.1 Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:51:52.182847 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.184420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '26342276-eba9-44e6-9959-33387a610f2b'} Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:52.185314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. Aug 08 02:51:52.187164 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:52.191747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance 26342276-eba9-44e6-9959-33387a610f2b could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:52.191747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6a1a5b96-2380-4fd9-ba6f-c92f83d0918d tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b" status: 404 len: 111 microversion: 2.1 time: 0.029261 Aug 08 02:51:52.191747 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 596/1199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:52 2022] GET /compute/v2.1/servers/26342276-eba9-44e6-9959-33387a610f2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:51:53.490405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:53.490928 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:53.497307 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:53.497786 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:53.498222 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:53.498948 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:53.499398 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:53.499825 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:53.512989 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 HTTP/1.1 Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 02:51:53.514528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.516149 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'f7aefc19-4687-4608-95c1-07161c73b0f0'} Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:53.517162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.518725 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.520280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:53.520280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ab0473b7-4bf5-4260-b229-9e60babf27d7 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 404 len: 111 microversion: 2.1 time: 0.030082 Aug 08 02:51:53.520280 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 604/1200] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:51:53 2022] DELETE /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:51:53.525416 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:51:53.526022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] [instance: f7aefc19-4687-4608-95c1-07161c73b0f0] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:51:53.532343 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:53.533384 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:53.533813 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:53.534530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:51:53.534982 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:51:53.535397 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:51:53.549158 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] HTTP exception thrown: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Request method failure captured: Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 HTTP/1.1 Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HiiricFpPIEB62glnCH6ewKZpPU0wH7NxfL3rn41UmSHBZRFc3FrM7IjJUxqPPe20cbZtbWXwKrxNZh405E9xn9zeoJv3bpghDrLFJVpkTOvarSp2bXOtup8DWOUSKPCNbekJeXd86fKxCDVrP8vo-HLiFRg0ogsThNQ2XTFdSBksM Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:51:53.550699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_570f253b2653418dabc6566536e14353"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/570f253b2653418dabc6566536e14353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/570f253b2653418dabc6566536e14353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 570f253b2653418dabc6566536e14353 Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1253687646 Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: f3a60f8c44524cc4a7a394060e619b9d Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-AttachVolumeNegativeTest-1253687646-project Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.552345 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': 'f7aefc19-4687-4608-95c1-07161c73b0f0'} Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:51:53.553482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. Aug 08 02:51:53.555018 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:51:53.556470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] Returning 404 to user: Instance f7aefc19-4687-4608-95c1-07161c73b0f0 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:51:53.556470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fa72a152-e8fc-43a2-b790-5690e500fd92 tempest-AttachVolumeNegativeTest-1253687646 tempest-AttachVolumeNegativeTest-1253687646-project] 10.222.0.15 "GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0" status: 404 len: 111 microversion: 2.1 time: 0.030777 Aug 08 02:51:53.556470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 597/1201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:51:53 2022] GET /compute/v2.1/servers/f7aefc19-4687-4608-95c1-07161c73b0f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:52:27.981814 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:52:27.982465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 02:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:53:17.420607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:17.420607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:17.420607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1754598660", "imageRef": "56e16cec-10fa-4bbb-87f6-82dc70c01254", "flavorRef": "452"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:53:17.668677 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] validate_networks() for None {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:53:18.177620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:53:18.177983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:53:18.178487 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:53:18.178900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:53:18.179312 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:53:18.188357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:18.188841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:18.189282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:18.190013 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:18.190494 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:18.190924 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:18.207762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Getting quotas for project 370376db13ed46e1bfbff9a5741f87ac. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:53:18.211682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Getting quotas for user 2ac4d7cd8de1449ab0a3b143971a2616 and project 370376db13ed46e1bfbff9a5741f87ac. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:53:18.223237 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:53:18.225458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56e16cec-10fa-4bbb-87f6-82dc70c01254',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:53:18.377639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e315f125-5ad1-4137-8bbc-71a92432f7cf tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968220 Aug 08 02:53:18.378287 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 605/1202] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:53:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:53:18.390109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-8aae44a1-2336-46e3-96dc-5c36e16bd829 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:18.390881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-8aae44a1-2336-46e3-96dc-5c36e16bd829 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:18.392958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:18.393641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:18.558997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-8aae44a1-2336-46e3-96dc-5c36e16bd829 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:18.558997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-8aae44a1-2336-46e3-96dc-5c36e16bd829 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1215 microversion: 2.1 time: 0.171574 Aug 08 02:53:18.558997 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 598/1203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:18 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:19.577823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:19.578456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:19.584998 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:19.585475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:19.585906 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:19.586617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:19.587097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:19.587520 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:19.647671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:19.655057 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3589def9-5975-4a59-b2c7-7e3999c87ee6 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1219 microversion: 2.1 time: 0.081885 Aug 08 02:53:19.655620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 606/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:19 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:20.675974 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:20.677141 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:20.685170 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:20.685853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:20.686571 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:20.687489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:20.687941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:20.688361 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:20.757711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:20.766071 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-1adb8b5b-e662-4908-8649-1a88a83ef7e2 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1285 microversion: 2.1 time: 0.094318 Aug 08 02:53:20.768755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 599/1205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:20 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:21.786995 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:21.787515 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:21.793933 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:21.794580 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:21.795022 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:21.795736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:21.796174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:21.796673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:21.930316 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:21.938042 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2578b84f-3eb2-42be-be62-1fceaf4c2ab1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.155063 Aug 08 02:53:21.938640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 607/1206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:21 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:53:22.333590 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-b283d34e-e3be-406e-b95a-7b81dfceb8ab req-2cfd4c67-8049-4ae7-9707-a99bb83513a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6461ef34-7b69-41ed-b2b8-d941ba6ad4ed", "tag": "d989145e-bf1a-4794-99dc-abe443fbc4e1"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:53:22.344644 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-b283d34e-e3be-406e-b95a-7b81dfceb8ab req-2cfd4c67-8049-4ae7-9707-a99bb83513a3 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:22.345110 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-b283d34e-e3be-406e-b95a-7b81dfceb8ab req-2cfd4c67-8049-4ae7-9707-a99bb83513a3 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:22.345744 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-b283d34e-e3be-406e-b95a-7b81dfceb8ab req-2cfd4c67-8049-4ae7-9707-a99bb83513a3 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:22.356949 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-b283d34e-e3be-406e-b95a-7b81dfceb8ab req-2cfd4c67-8049-4ae7-9707-a99bb83513a3 service nova] Creating event network-changed:d989145e-bf1a-4794-99dc-abe443fbc4e1 for instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed on hv-cinder-85226 Aug 08 02:53:22.361944 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-b283d34e-e3be-406e-b95a-7b81dfceb8ab req-2cfd4c67-8049-4ae7-9707-a99bb83513a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032584 Aug 08 02:53:22.362565 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 600/1207] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:53:22.963535 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:22.964127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:22.971073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:22.974778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:22.974778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:22.974778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:22.974778 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:22.975203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:23.103692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:23.111806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bb2f022d-5513-4d0e-ad8f-7e4970c167f7 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.152324 Aug 08 02:53:23.112372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 608/1208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:22 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:24.133519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:24.134207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:24.140677 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:24.141151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:24.141576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:24.142249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:24.142723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:24.143140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:24.273411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:24.280897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f365427f-73da-4dcd-9738-36448c6e01a9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.152010 Aug 08 02:53:24.281458 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 601/1209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:24 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:25.301956 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:25.302594 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:25.309999 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:25.310502 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:25.311189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:25.311886 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:25.312332 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:25.312755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:25.439665 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:25.447102 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ef99e39f-bd85-47f4-83be-b6c2307a4d57 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.148972 Aug 08 02:53:25.447666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 609/1210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:25 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:26.469249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:26.469769 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:26.476139 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:26.476614 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:26.477047 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:26.477733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:26.478184 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:26.478645 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:26.606138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:26.613507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-cbdd143a-a094-431a-97eb-d209bf28cd6c tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.148760 Aug 08 02:53:26.614063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 602/1211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:26 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:27.633925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:27.634445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:27.640911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:27.641446 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:27.641888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:27.642610 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:27.643086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:27.644388 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:27.774693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:27.782747 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2fa446de-1a54-441c-90bc-7de2368fa420 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.152795 Aug 08 02:53:27.783343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 610/1212] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:27 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:28.802538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:28.803174 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:28.805655 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:28.811439 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:28.811914 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:28.812346 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:28.813029 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:28.813482 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:28.813904 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:28.944524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:28.952165 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-49451111-fec7-45ec-a5c2-1c023cb47c3a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.153558 Aug 08 02:53:28.952727 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 603/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:28 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:29.463116 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-527c09d6-f0e0-4a3c-b6ba-9f7445fcd703 req-5f68ab3a-e821-4201-94e5-77b7e2056254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6461ef34-7b69-41ed-b2b8-d941ba6ad4ed", "name": "network-vif-plugged", "status": "completed", "tag": "d989145e-bf1a-4794-99dc-abe443fbc4e1"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:53:29.468958 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:29.469631 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:29.475261 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-527c09d6-f0e0-4a3c-b6ba-9f7445fcd703 req-5f68ab3a-e821-4201-94e5-77b7e2056254 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:29.475946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-527c09d6-f0e0-4a3c-b6ba-9f7445fcd703 req-5f68ab3a-e821-4201-94e5-77b7e2056254 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:29.476282 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-527c09d6-f0e0-4a3c-b6ba-9f7445fcd703 req-5f68ab3a-e821-4201-94e5-77b7e2056254 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:29.487447 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-527c09d6-f0e0-4a3c-b6ba-9f7445fcd703 req-5f68ab3a-e821-4201-94e5-77b7e2056254 service nova] Creating event network-vif-plugged:d989145e-bf1a-4794-99dc-abe443fbc4e1 for instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed on hv-cinder-85226 Aug 08 02:53:29.492657 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-527c09d6-f0e0-4a3c-b6ba-9f7445fcd703 req-5f68ab3a-e821-4201-94e5-77b7e2056254 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Aug 08 02:53:29.493308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 611/1214] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:53:29.972652 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:29.973265 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:29.979750 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:29.980223 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:29.981147 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:29.981827 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:29.982406 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:29.982828 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:30.112559 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:30.119934 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3158ae93-c7e5-43af-9f25-971f4086dd8a tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.151245 Aug 08 02:53:30.120493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 604/1215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:29 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:31.142132 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:31.142857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:31.150568 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:31.151050 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:31.151490 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:31.152183 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:31.152671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:31.153213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:31.283046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:31.291419 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f54fc439-8c2e-4045-ab91-1fc2e672def1 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1315 microversion: 2.1 time: 0.154320 Aug 08 02:53:31.297476 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 612/1216] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:31 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:32.312271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:32.312881 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:32.319354 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:32.319833 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:32.320267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:32.320958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:32.321411 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:32.321832 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:32.455068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:32.462460 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-071943a1-cc85-4504-9c12-193fe8535067 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1465 microversion: 2.1 time: 0.154346 Aug 08 02:53:32.463025 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 605/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:32 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:32.506596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:32.507098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:32.515029 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:32.515508 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:32.515976 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:32.516666 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:32.517114 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:32.517536 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:32.542469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:53:32.810952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-11f80597-eba8-4896-b611-006654917577 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 204 len: 0 microversion: 2.1 time: 0.307640 Aug 08 02:53:32.813673 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 613/1218] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:53:32 2022] DELETE /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:53:32.819721 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:32.820332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:32.827374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:32.827850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:32.828295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:32.828967 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:32.829417 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:32.829838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:32.959812 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:32.967415 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e13554a1-14c6-4f8a-9c17-3e709b8cdce9 tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1471 microversion: 2.1 time: 0.151596 Aug 08 02:53:32.967973 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 606/1219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:32 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:33.988401 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:33.989084 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:33.995405 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:33.995878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:33.996404 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:33.997299 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:33.997777 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:33.998217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:34.136179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:34.144459 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1d298dbb-2687-4f31-a3ff-bd70aa9167aa tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1471 microversion: 2.1 time: 0.160220 Aug 08 02:53:34.145018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 614/1220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:33 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:35.053489 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-629c6550-856d-468f-999c-74a1399bb2d8 req-e49b09b2-46d4-4d68-bd01-3aec9002703f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6461ef34-7b69-41ed-b2b8-d941ba6ad4ed", "name": "network-vif-deleted", "tag": "d989145e-bf1a-4794-99dc-abe443fbc4e1"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:53:35.063537 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-629c6550-856d-468f-999c-74a1399bb2d8 req-e49b09b2-46d4-4d68-bd01-3aec9002703f service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:35.064013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-629c6550-856d-468f-999c-74a1399bb2d8 req-e49b09b2-46d4-4d68-bd01-3aec9002703f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:35.064453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-629c6550-856d-468f-999c-74a1399bb2d8 req-e49b09b2-46d4-4d68-bd01-3aec9002703f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:35.076966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-629c6550-856d-468f-999c-74a1399bb2d8 req-e49b09b2-46d4-4d68-bd01-3aec9002703f service nova] Creating event network-vif-deleted:d989145e-bf1a-4794-99dc-abe443fbc4e1 for instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed on hv-cinder-85226 Aug 08 02:53:35.082092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-629c6550-856d-468f-999c-74a1399bb2d8 req-e49b09b2-46d4-4d68-bd01-3aec9002703f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032262 Aug 08 02:53:35.082733 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 607/1221] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:53:35.165223 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:35.165851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:35.173172 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:35.173899 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:35.174335 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:35.175110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:35.175513 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:35.175943 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:35.240077 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac4d7cd8de1449ab0a3b143971a2616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370376db13ed46e1bfbff9a5741f87ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:53:35.248436 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8b124a63-2e8c-4f23-9173-d99b03a9761d tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 200 len: 1429 microversion: 2.1 time: 0.087111 Aug 08 02:53:35.249001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 615/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:35 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:53:36.270143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:53:36.270861 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] [instance: 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:53:36.276932 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:36.277407 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:36.278501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:36.279271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:53:36.279723 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:53:36.280143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:53:36.293113 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] HTTP exception thrown: Instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed could not be found. Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Request method failure captured: Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed HTTP/1.1 Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8HqbQh4NpDyd4hEyinK6w1ALJMri2Y4kG91eimIEGAO_9fxU749BGSze-yRfQQ8L4dxLQg1py6jyriwyE7sadGngYoXkiUG9SMb-MP9jwq7urUp9O6F-mrczHw7ApeVwUU3R-6y5ejv9omhf7RmgsMbniGXHPS9ysafuvnTi25rblgk Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: 370376db13ed46e1bfbff9a5741f87ac Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-VolumesNegativeTest-311285532 Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:53:36.294824 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_370376db13ed46e1bfbff9a5741f87ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/370376db13ed46e1bfbff9a5741f87ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/370376db13ed46e1bfbff9a5741f87ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/370376db13ed46e1bfbff9a5741f87ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-VolumesNegativeTest-311285532 Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: 370376db13ed46e1bfbff9a5741f87ac Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-VolumesNegativeTest-311285532 Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-VolumesNegativeTest-311285532-project Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 2ac4d7cd8de1449ab0a3b143971a2616 Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-VolumesNegativeTest-311285532-project Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed could not be found. Aug 08 02:53:36.296620 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '6461ef34-7b69-41ed-b2b8-d941ba6ad4ed'} Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed could not be found. Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:53:36.297532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed could not be found. Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed could not be found. Aug 08 02:53:36.299022 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:53:36.300377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] Returning 404 to user: Instance 6461ef34-7b69-41ed-b2b8-d941ba6ad4ed could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:53:36.300377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-0e7e3cbe-38ed-449d-b64a-41e65a6abfed tempest-VolumesNegativeTest-311285532 tempest-VolumesNegativeTest-311285532-project] 10.222.0.15 "GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed" status: 404 len: 111 microversion: 2.1 time: 0.030792 Aug 08 02:53:36.300377 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 608/1223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:53:36 2022] GET /compute/v2.1/servers/6461ef34-7b69-41ed-b2b8-d941ba6ad4ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:53:55.291869 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:55.293253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:53:55.461454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2666b021-a5ec-4de6-901b-51961e39a1f0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Action: 'create', calling method: .version_select at 0x7fb2bab95820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-710688674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuyJ1O+FNIB100EwyCvzXYYgbVS0sEA32w7+3MDCXK46oW0Ykp1WQ7pRBrIYkzZobXWxy4m/+IWlWIjslW8AB9LPdO/OWY2DkX6K0HMW5OG5eUnZtuDjDBbZJfXR7auQQ=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:53:55.477278 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-2666b021-a5ec-4de6-901b-51961e39a1f0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for project cdf9c8d3eace468d852b873213f392f4. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:53:55.481546 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-2666b021-a5ec-4de6-901b-51961e39a1f0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for user 74a5ed7c176f44849677acf29c330e97 and project cdf9c8d3eace468d852b873213f392f4. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:53:55.556558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2666b021-a5ec-4de6-901b-51961e39a1f0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.269541 Aug 08 02:53:55.557162 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 616/1224] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 02:53:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:54:18.874287 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1684855702", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710688674", "security_groups": [{"name": "tempest-secgroup-smoke-1385983741"}], "block_device_mapping_v2": [{"uuid": "91a9c198-431d-476c-9e71-5128dbb74f31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a6048054-e97a-4e19-a2b6-2b1d1f8ee921"}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:54:18.883963 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=24 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:18.884779 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=48 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:18.990922 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] validate_networks() for [('a6048054-e97a-4e19-a2b6-2b1d1f8ee921', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:54:19.443916 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:54:19.444389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:54:19.444873 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:54:19.445280 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:54:19.445692 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:54:19.454921 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:19.455399 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:19.455834 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:19.456564 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:19.457087 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:19.457515 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:19.474266 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for project cdf9c8d3eace468d852b873213f392f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:54:19.478224 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for user 74a5ed7c176f44849677acf29c330e97 and project cdf9c8d3eace468d852b873213f392f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:54:19.534305 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:54:19.536491 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91a9c198-431d-476c-9e71-5128dbb74f31',volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:54:19.962878 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-132790ae-0f21-4fea-a8c7-7a0f4efbc862 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.092336 Aug 08 02:54:19.963618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 609/1225] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:54:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:54:19.972180 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:19.972931 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:19.976838 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1670cf4d-6c3e-4746-a742-39d0139f816b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:19.977443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1670cf4d-6c3e-4746-a742-39d0139f816b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:20.036314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1670cf4d-6c3e-4746-a742-39d0139f816b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:20.044242 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1670cf4d-6c3e-4746-a742-39d0139f816b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1094 microversion: 2.1 time: 0.073346 Aug 08 02:54:20.044809 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 617/1226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:19 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:21.065684 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:21.066290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:21.073131 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:21.073619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:21.074177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:21.074900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:21.075395 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:21.075817 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:21.138518 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:21.146013 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6b6a4e55-ca44-424e-a4d7-74eeb965989b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1144 microversion: 2.1 time: 0.084610 Aug 08 02:54:21.146613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 610/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:21 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:22.168523 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:22.169852 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:22.177372 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:22.177894 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:22.178555 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:22.179498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:22.179718 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:22.180143 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:22.245522 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:22.253871 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-015591f2-3fad-4c55-acb1-c318fb01aeb2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1200 microversion: 2.1 time: 0.090523 Aug 08 02:54:22.254529 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 618/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:22 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:23.275050 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:23.276741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:23.284061 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:23.284786 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:23.285394 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:23.286478 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:23.287121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:23.287551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:23.476335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:23.485028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-99e5fe8f-8269-4ed1-8852-54a371fbee9b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1278 microversion: 2.1 time: 0.214281 Aug 08 02:54:23.485600 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 611/1229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:23 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:23.898763 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-c632ed7b-f92d-400e-acc3-90a4da68136a req-9f685cce-5716-484f-8f59-86dcf3551c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db7557f-f807-42e7-8b82-65907d38a8f8", "tag": "90653888-3b9e-4656-9311-7ff54fceba03"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:54:23.909471 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c632ed7b-f92d-400e-acc3-90a4da68136a req-9f685cce-5716-484f-8f59-86dcf3551c5b service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:23.909949 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c632ed7b-f92d-400e-acc3-90a4da68136a req-9f685cce-5716-484f-8f59-86dcf3551c5b service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:23.910480 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c632ed7b-f92d-400e-acc3-90a4da68136a req-9f685cce-5716-484f-8f59-86dcf3551c5b service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:23.926300 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-c632ed7b-f92d-400e-acc3-90a4da68136a req-9f685cce-5716-484f-8f59-86dcf3551c5b service nova] Creating event network-changed:90653888-3b9e-4656-9311-7ff54fceba03 for instance 2db7557f-f807-42e7-8b82-65907d38a8f8 on hv-cinder-85226 Aug 08 02:54:23.931001 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-c632ed7b-f92d-400e-acc3-90a4da68136a req-9f685cce-5716-484f-8f59-86dcf3551c5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036036 Aug 08 02:54:23.936623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 619/1230] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:54:24.506699 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:24.511700 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:24.513935 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:24.514457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:24.514900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:24.515599 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:24.516055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:24.516483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:24.682303 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:24.690052 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fb0b134f-f221-4547-866a-3b62d037a703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.187333 Aug 08 02:54:24.690981 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 612/1231] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:24 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:25.712807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:25.714049 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:25.720134 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:25.720609 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:25.721046 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:25.721729 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:25.722182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:25.722644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:25.854217 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:25.861639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-53d6a448-a9f1-430e-b746-c2297869859c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.153504 Aug 08 02:54:25.862200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 620/1232] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:25 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:26.882710 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:26.883318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:26.891328 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:26.891802 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:26.892230 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:26.892943 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:26.893389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:26.893807 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:27.025841 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:27.033374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-31f5a4ed-6e3e-4b73-801a-5ba8adefd7cb tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.154798 Aug 08 02:54:27.036090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 613/1233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:26 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:28.054473 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:28.055105 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:28.062338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:28.062875 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:28.063310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:28.063997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:28.064445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:28.064865 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:28.195263 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:28.203775 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-322fd26b-7455-4722-8f6f-3bf5db9e1d24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.153139 Aug 08 02:54:28.204377 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 621/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:28 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:29.224424 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:29.225023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:29.231931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:29.232425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:29.232925 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:29.233646 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:29.234106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:29.234565 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:29.366014 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:29.374043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-35d2346b-aa3d-4d6f-af60-a8b288318ed9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.153579 Aug 08 02:54:29.374651 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 614/1235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:29 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:30.394833 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:30.395471 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:30.397959 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:30.402896 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:30.403373 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:30.403839 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:30.404537 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:30.404993 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:30.405454 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:30.537315 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:30.544841 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8324ea33-1e65-4643-96fb-e7488b848477 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.153877 Aug 08 02:54:30.545430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 622/1236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:30 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:31.566069 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:31.566703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:31.568535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:31.569203 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:54:31.575135 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:31.575613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:31.576044 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:31.576731 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:31.577182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:31.577606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:31.707918 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:31.715885 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-58fd6b06-7d85-460c-8e29-c6ea3305e2bc tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.153671 Aug 08 02:54:31.716445 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 615/1237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:31 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:32.736531 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:32.737083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:32.743756 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:32.744617 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:32.745054 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:32.745744 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:32.746456 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:32.746885 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:32.883424 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:32.891012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b386df0c-e26b-4d74-a9c7-84be024d22f8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.158415 Aug 08 02:54:32.891611 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 623/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:32 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:33.912454 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:33.912992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:33.920057 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:33.920545 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:33.920979 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:33.921672 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:33.922125 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:33.922576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:34.051966 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:34.059924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-97d24a7f-510c-4d49-8ff0-5213d00c851f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.151332 Aug 08 02:54:34.097689 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 616/1239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:33 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:35.080984 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:35.081596 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:35.088012 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:35.088496 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:35.088934 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:35.089623 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:35.090074 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:35.090540 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:35.219653 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:35.227075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0bd7942e-8d48-4765-8f19-6aa70a92367f tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.150067 Aug 08 02:54:35.227638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 624/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:35 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:35.759402 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-d8c871ad-6b68-4cd2-99e1-bacf10cdaff8 req-5b5bcc8f-298d-4cee-bd99-3e1178bce7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db7557f-f807-42e7-8b82-65907d38a8f8", "name": "network-vif-plugged", "status": "completed", "tag": "90653888-3b9e-4656-9311-7ff54fceba03"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:54:35.769840 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d8c871ad-6b68-4cd2-99e1-bacf10cdaff8 req-5b5bcc8f-298d-4cee-bd99-3e1178bce7b9 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:35.770312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d8c871ad-6b68-4cd2-99e1-bacf10cdaff8 req-5b5bcc8f-298d-4cee-bd99-3e1178bce7b9 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:35.770764 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d8c871ad-6b68-4cd2-99e1-bacf10cdaff8 req-5b5bcc8f-298d-4cee-bd99-3e1178bce7b9 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:35.782420 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-d8c871ad-6b68-4cd2-99e1-bacf10cdaff8 req-5b5bcc8f-298d-4cee-bd99-3e1178bce7b9 service nova] Creating event network-vif-plugged:90653888-3b9e-4656-9311-7ff54fceba03 for instance 2db7557f-f807-42e7-8b82-65907d38a8f8 on hv-cinder-85226 Aug 08 02:54:35.787210 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-d8c871ad-6b68-4cd2-99e1-bacf10cdaff8 req-5b5bcc8f-298d-4cee-bd99-3e1178bce7b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031613 Aug 08 02:54:35.787781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 617/1241] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:54:36.247918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:36.248527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:36.254975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:36.255455 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:36.255888 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:36.256575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:36.257221 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:36.257646 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:36.397306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:36.405392 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fe2c4d44-bad8-4957-b1e6-40ea96a783f5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.161406 Aug 08 02:54:36.405950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 625/1242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:36 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:37.426452 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:37.427143 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:37.433444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:37.434170 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:37.434618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:37.435302 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:37.435739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:37.436152 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:37.565790 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:37.574119 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3fffafff-e401-44bb-89ad-38dfe2d5d4d6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.152406 Aug 08 02:54:37.574731 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 618/1243] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:37 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:38.594682 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:38.595296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:38.601215 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:38.601690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:38.602127 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:38.602919 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:38.603901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:38.604319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:38.731969 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:38.739310 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e7e711d6-378d-4e8f-b298-3c0f0c47c3b8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1454 microversion: 2.1 time: 0.148675 Aug 08 02:54:38.739861 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 626/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:38 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:38.759151 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:54:38.759838 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:54:38.766072 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:38.766576 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:38.767007 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:38.767688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:38.768142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:38.768560 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:38.898364 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:54:38.906429 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-6c7ef815-210f-49b8-aee4-f4f62efb6a14 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1454 microversion: 2.1 time: 0.151085 Aug 08 02:54:38.906994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 619/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:54:38 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:54:41.065918 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-6cdc1774-f3ee-42a5-ad0c-50b3292baa36 req-243616df-12da-4007-a904-fc84d861acb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db7557f-f807-42e7-8b82-65907d38a8f8", "tag": "90653888-3b9e-4656-9311-7ff54fceba03"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:54:41.076479 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-6cdc1774-f3ee-42a5-ad0c-50b3292baa36 req-243616df-12da-4007-a904-fc84d861acb1 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:54:41.077038 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-6cdc1774-f3ee-42a5-ad0c-50b3292baa36 req-243616df-12da-4007-a904-fc84d861acb1 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:54:41.077471 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-6cdc1774-f3ee-42a5-ad0c-50b3292baa36 req-243616df-12da-4007-a904-fc84d861acb1 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:54:41.089247 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-6cdc1774-f3ee-42a5-ad0c-50b3292baa36 req-243616df-12da-4007-a904-fc84d861acb1 service nova] Creating event network-changed:90653888-3b9e-4656-9311-7ff54fceba03 for instance 2db7557f-f807-42e7-8b82-65907d38a8f8 on hv-cinder-85226 Aug 08 02:54:41.094276 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-6cdc1774-f3ee-42a5-ad0c-50b3292baa36 req-243616df-12da-4007-a904-fc84d861acb1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032068 Aug 08 02:54:41.094884 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 627/1246] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:55:47.445738 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:55:47.446481 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 02:55:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:56:55.250426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:56:55.251097 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=58 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:56:55.254971 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:56:55.255535 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:56:55.261318 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:55.267109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:55.267109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:55.267109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:55.267109 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:55.267526 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:55.290337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:56:55.489618 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR oslo.messaging._drivers.impl_rabbit [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [de355d10-2449-47e0-85a4-5d93cd8ae130] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:56:56.496495 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [de355d10-2449-47e0-85a4-5d93cd8ae130] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57406. Aug 08 02:56:56.577941 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-042ddb9d-c157-4f6a-9b7c-dc06c22503ae tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 204 len: 0 microversion: 2.1 time: 1.330361 Aug 08 02:56:56.578598 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 620/1247] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 02:56:55 2022] DELETE /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 0 bytes in 1332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:56:56.585250 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b84842f-1ecb-4037-be75-a807c48882c9] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 02:56:56.585878 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=24 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:56:56.586635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=52 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:56:56.590992 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:56:56.591691 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:56:56.597796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:56.598309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:56.598782 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:56.599471 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:56.599925 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:56.600357 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:56.737320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:56:56.744688 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-377a1b79-50f5-4914-b7e5-2e51f2abffac tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1578 microversion: 2.1 time: 0.161709 Aug 08 02:56:56.745245 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 628/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:56:56 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:56:57.767671 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:56:57.768314 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:56:57.775392 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:57.775871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:57.776311 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:57.776996 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:57.777450 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:57.777877 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:57.910728 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:56:57.918575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e5903724-46a7-4626-8688-eeb352cc3a26 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1578 microversion: 2.1 time: 0.155780 Aug 08 02:56:57.919418 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 621/1249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:56:57 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:56:58.940720 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:56:58.941343 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:56:58.949220 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:58.949745 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:58.950145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:58.950881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:58.951340 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:58.951769 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:58.957805 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b84842f-1ecb-4037-be75-a807c48882c9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57418. Aug 08 02:56:59.021916 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:56:59.029846 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2d529772-276e-4688-a55b-e8bfa2d27286 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1510 microversion: 2.1 time: 0.093669 Aug 08 02:56:59.030430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 629/1250] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:56:58 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:56:59.629927 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-d9c36a76-9821-4e94-b9a1-c9faa092b2c0 req-67f686d5-2bb7-4314-bf1c-08950a8f1380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db7557f-f807-42e7-8b82-65907d38a8f8", "name": "network-vif-deleted", "tag": "90653888-3b9e-4656-9311-7ff54fceba03"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:56:59.639913 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d9c36a76-9821-4e94-b9a1-c9faa092b2c0 req-67f686d5-2bb7-4314-bf1c-08950a8f1380 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:56:59.644244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d9c36a76-9821-4e94-b9a1-c9faa092b2c0 req-67f686d5-2bb7-4314-bf1c-08950a8f1380 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:56:59.644244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-d9c36a76-9821-4e94-b9a1-c9faa092b2c0 req-67f686d5-2bb7-4314-bf1c-08950a8f1380 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:56:59.656548 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-d9c36a76-9821-4e94-b9a1-c9faa092b2c0 req-67f686d5-2bb7-4314-bf1c-08950a8f1380 service nova] Creating event network-vif-deleted:90653888-3b9e-4656-9311-7ff54fceba03 for instance 2db7557f-f807-42e7-8b82-65907d38a8f8 on hv-cinder-85226 Aug 08 02:56:59.661613 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-d9c36a76-9821-4e94-b9a1-c9faa092b2c0 req-67f686d5-2bb7-4314-bf1c-08950a8f1380 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096859 Aug 08 02:56:59.662207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 622/1251] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:57:00.052522 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:00.053361 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:00.060570 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:00.061135 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:00.061693 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:00.063047 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:00.063533 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:00.063957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:00.129498 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:00.137154 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c93740d0-dd5e-456b-ae65-598fed29b1ce tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 200 len: 1225 microversion: 2.1 time: 0.090013 Aug 08 02:57:00.137713 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 630/1252] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:00 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:01.159666 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:01.160358 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:01.166987 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:01.167466 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:01.167897 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:01.168580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:01.169032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:01.169453 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:01.183600 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] HTTP exception thrown: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Request method failure captured: Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 HTTP/1.1 Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8Hq9FW1mAVnZyod4VTpBxr8WggqmaxJp94RGCmHwOT9_vfi7Vvrz-SCvqab75hunBvBrkVR28vYEbcQTBry6z6zqGsRQRWOrQurXejsA3Sol5S976YchoZqiiq-czDRgtXrX4ZviBKyfaxJyUbNBE8ZkOFBjlwYYMw7sycVsgFpbWmw Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 02:57:01.185171 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-TestVolumeBootPattern-946919866 Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-TestVolumeBootPattern-946919866-project Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 74a5ed7c176f44849677acf29c330e97 Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-TestVolumeBootPattern-946919866-project Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 02:57:01.187211 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '2db7557f-f807-42e7-8b82-65907d38a8f8'} Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:57:01.188307 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 02:57:01.190023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 02:57:01.191641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Returning 404 to user: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:57:01.191641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-c4c07476-b979-48e3-91ad-5e706911b770 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 404 len: 111 microversion: 2.1 time: 0.031864 Aug 08 02:57:01.191641 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 623/1253] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:01 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:57:01.234443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-703308852", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710688674", "security_groups": [{"name": "tempest-secgroup-smoke-1385983741"}], "block_device_mapping_v2": [{"uuid": "91a9c198-431d-476c-9e71-5128dbb74f31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a6048054-e97a-4e19-a2b6-2b1d1f8ee921"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:57:01.345834 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] validate_networks() for [('a6048054-e97a-4e19-a2b6-2b1d1f8ee921', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:57:01.458117 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:57:01.458499 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 02:57:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Aug 08 02:57:01.769609 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:57:01.770039 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:57:01.770542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:57:01.770950 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:57:01.771362 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:57:01.779853 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:01.780341 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:01.781389 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:01.782270 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:01.782757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:01.783190 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:01.799668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for project cdf9c8d3eace468d852b873213f392f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:57:01.803921 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for user 74a5ed7c176f44849677acf29c330e97 and project cdf9c8d3eace468d852b873213f392f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:57:01.860384 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:57:01.862561 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91a9c198-431d-476c-9e71-5128dbb74f31',volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:57:02.220482 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7077ff9f-fc07-4930-98d8-0ba97a3bd059 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.990423 Aug 08 02:57:02.221172 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 631/1254] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:57:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:57:02.232090 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-223b8755-ff01-41e5-8bb4-e2043131e652 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:02.232703 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-223b8755-ff01-41e5-8bb4-e2043131e652 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:02.288390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-223b8755-ff01-41e5-8bb4-e2043131e652 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:02.295045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-223b8755-ff01-41e5-8bb4-e2043131e652 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1093 microversion: 2.1 time: 0.066988 Aug 08 02:57:02.295600 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 624/1255] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:02 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:03.316843 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:03.317469 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:03.325000 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:03.325542 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:03.325982 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:03.326737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:03.327216 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:03.327699 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:03.392254 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:03.400965 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3729157e-6946-4987-9151-e618eed0bc1b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1143 microversion: 2.1 time: 0.088044 Aug 08 02:57:03.401541 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 632/1256] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:03 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:04.421365 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:04.422880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:04.429324 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:04.430068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:04.430532 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:04.431226 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:04.431683 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:04.432108 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:04.493288 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:04.501986 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-49ce571c-540a-4066-bf73-4b642195b703 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1209 microversion: 2.1 time: 0.083489 Aug 08 02:57:04.502603 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 625/1257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:04 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:57:05.523358 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:05.523972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:05.530345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:05.530851 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:05.531291 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:05.532075 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:05.532574 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:05.533004 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:05.666854 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:05.674649 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c61ae8b2-bcdf-40cc-b882-141ec2336400 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.155049 Aug 08 02:57:05.675308 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 633/1258] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:05 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:57:05.885653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-a8d81cee-1103-4357-b879-ad449bd64efc req-a8c436d6-24ba-4385-96e0-ae0456362d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f4cf43-9cde-4bfb-9c94-b8b4c530938f", "tag": "43f4773b-1fae-41e1-8ce6-050724184dee"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:57:05.895648 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a8d81cee-1103-4357-b879-ad449bd64efc req-a8c436d6-24ba-4385-96e0-ae0456362d09 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:05.896124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a8d81cee-1103-4357-b879-ad449bd64efc req-a8c436d6-24ba-4385-96e0-ae0456362d09 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:05.896681 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-a8d81cee-1103-4357-b879-ad449bd64efc req-a8c436d6-24ba-4385-96e0-ae0456362d09 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:05.907554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-a8d81cee-1103-4357-b879-ad449bd64efc req-a8c436d6-24ba-4385-96e0-ae0456362d09 service nova] Creating event network-changed:43f4773b-1fae-41e1-8ce6-050724184dee for instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f on hv-cinder-85226 Aug 08 02:57:05.912631 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-a8d81cee-1103-4357-b879-ad449bd64efc req-a8c436d6-24ba-4385-96e0-ae0456362d09 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030870 Aug 08 02:57:05.913437 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 626/1259] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:57:06.695675 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:06.696283 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:06.702668 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:06.703144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:06.703576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:06.704298 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:06.704747 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:06.705198 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:06.834527 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:06.841900 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3e6c5d56-d1cd-4921-9044-1a5bffb2c9ad tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.150054 Aug 08 02:57:06.842483 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 634/1260] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:06 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:07.863778 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:07.864506 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:07.871140 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:07.871621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:07.872060 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:07.872781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:07.873241 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:07.873665 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:08.009133 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:08.016653 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-e8f15af5-79d0-4d0a-8190-55de25b6c5bd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.157536 Aug 08 02:57:08.017249 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 627/1261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:07 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:09.037789 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:09.043731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:09.045213 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:09.045700 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:09.046135 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:09.046868 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:09.047320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:09.048445 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:09.190142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:09.197504 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3233ee24-658d-405c-9dde-5b65f10eca81 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.163678 Aug 08 02:57:09.198061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 635/1262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:09 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:10.217924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:10.218476 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:10.224900 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:10.225370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:10.225799 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:10.226501 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:10.226951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:10.227370 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:10.357803 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:10.365863 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-26d66d75-b3fe-476f-b2af-6145cfd74ff6 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.151979 Aug 08 02:57:10.366442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 628/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:10 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:11.386957 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:11.387576 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:11.394674 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:11.395158 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:11.395601 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:11.396295 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:11.396749 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:11.397176 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:11.527375 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:11.534972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-67b151f1-adc6-4d71-9e7a-246be08872d0 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.151852 Aug 08 02:57:11.535544 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 636/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:11 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:12.556233 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:12.556845 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:12.559267 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:57:12.564142 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:12.564609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:12.565034 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:12.565711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:12.566156 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:12.566593 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:12.695616 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:12.703055 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-fb5c12d9-0f0e-4af6-9b94-cca78da4f349 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.150962 Aug 08 02:57:12.703612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 629/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:12 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:13.724774 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:13.725314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:13.727120 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:57:13.727822 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:57:13.733037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:13.738528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:13.738528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:13.738528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:13.738528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:13.738929 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:13.869141 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:13.876545 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f8eb9ff-de71-4443-bca2-de7d3213e091 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.155827 Aug 08 02:57:13.877097 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 637/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:13 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:14.896527 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:14.897132 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:14.903572 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:14.904043 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:14.904470 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:14.905150 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:14.905595 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:14.906009 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:15.043749 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:15.052194 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-4dba1247-0e24-4ba0-a623-2e7645a9e503 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.159568 Aug 08 02:57:15.052755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 630/1267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:14 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:16.073110 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:16.073721 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:16.080711 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:16.081196 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:16.081629 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:16.082376 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:16.082836 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:16.083264 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:16.225539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:16.226990 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-33d5ea37-ecbf-47f3-967d-dfa70777b6ee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.157850 Aug 08 02:57:16.227565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 638/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:16 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:16.777169 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-97bb8b1e-7f03-4001-b75a-55f752720f37 req-206e7619-00e4-4f49-93ef-62d68bb47947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f4cf43-9cde-4bfb-9c94-b8b4c530938f", "name": "network-vif-plugged", "status": "completed", "tag": "43f4773b-1fae-41e1-8ce6-050724184dee"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:57:16.786619 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-97bb8b1e-7f03-4001-b75a-55f752720f37 req-206e7619-00e4-4f49-93ef-62d68bb47947 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:16.787094 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-97bb8b1e-7f03-4001-b75a-55f752720f37 req-206e7619-00e4-4f49-93ef-62d68bb47947 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:16.787524 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-97bb8b1e-7f03-4001-b75a-55f752720f37 req-206e7619-00e4-4f49-93ef-62d68bb47947 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:16.798182 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-97bb8b1e-7f03-4001-b75a-55f752720f37 req-206e7619-00e4-4f49-93ef-62d68bb47947 service nova] Creating event network-vif-plugged:43f4773b-1fae-41e1-8ce6-050724184dee for instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f on hv-cinder-85226 Aug 08 02:57:16.803393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-97bb8b1e-7f03-4001-b75a-55f752720f37 req-206e7619-00e4-4f49-93ef-62d68bb47947 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084200 Aug 08 02:57:16.803994 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 631/1269] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:57:17.248443 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:17.249056 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:17.255528 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:17.256009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:17.256444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:17.257128 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:17.257577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:17.258006 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:17.386314 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:17.393966 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3007f488-c2d2-4aef-ab2a-bf6d12b5abee tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.149418 Aug 08 02:57:17.394554 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 639/1270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:17 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:18.415250 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:18.415947 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:18.422066 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:18.422586 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:18.423880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:18.424366 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:18.424825 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:18.425253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:18.558374 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:18.566739 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f644f380-db40-46d9-b49b-365a4adde68c tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1265 microversion: 2.1 time: 0.156134 Aug 08 02:57:18.567296 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 632/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:18 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:19.586986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:19.587599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:19.594017 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:19.594565 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:19.595071 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:19.595763 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:19.596215 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:19.596640 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:19.729171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:19.736635 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-65633c0d-84c1-4ef5-9258-0f0f6a1c6a24 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1453 microversion: 2.1 time: 0.153522 Aug 08 02:57:19.737200 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 640/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:19 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:57:19.756711 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:57:19.757253 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:57:19.763551 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:19.764023 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:19.764465 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:19.765128 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:19.765575 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:19.765992 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:19.896231 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:57:19.903987 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ae1e94c5-3287-48f8-8116-981c9201db87 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1453 microversion: 2.1 time: 0.151160 Aug 08 02:57:19.904568 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 633/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:57:19 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:57:21.726334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f4cf43-9cde-4bfb-9c94-b8b4c530938f", "tag": "43f4773b-1fae-41e1-8ce6-050724184dee"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:57:21.741692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:57:21.741692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:57:21.741692 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:57:21.749757 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] Creating event network-changed:43f4773b-1fae-41e1-8ce6-050724184dee for instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f on hv-cinder-85226 Aug 08 02:57:21.753804 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR oslo.messaging._drivers.impl_rabbit [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] [515228ff-5f5b-46de-8512-087d0ed4b3ee] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:57:22.079294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:57:22.079815 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 02:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:57:22.760519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] [515228ff-5f5b-46de-8512-087d0ed4b3ee] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57508. Aug 08 02:57:22.764043 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b024383c-ed67-4bcd-a03d-7fef9dc1e44e req-1fc4c58f-9844-4d41-8966-890bf746f431 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042138 Aug 08 02:57:22.764664 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 641/1274] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:57:27.991862 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:57:27.992312 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 02:57:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:59:26.823483 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaa3f877-e5a9-4ca8-b804-d43c3f324787] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 02:59:26.824137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:26.824937 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:26.828680 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1739044469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710688674", "security_groups": [{"name": "tempest-secgroup-smoke-1385983741"}], "block_device_mapping_v2": [{"uuid": "61f4a220-a88f-4484-93db-5df3420934a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a6048054-e97a-4e19-a2b6-2b1d1f8ee921"}]}} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:59:26.995857 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.network.neutron [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] validate_networks() for [('a6048054-e97a-4e19-a2b6-2b1d1f8ee921', None, None, None, None, None)] {{(pid=124658) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:59:27.409738 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Flavor limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:59:27.410158 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Image limits 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:59:27.410662 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Flavor pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:59:27.411068 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Image pref 0:0:0 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:59:27.411475 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.virt.hardware [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:59:27.420479 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:27.420958 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:27.421392 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:27.422116 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:27.422605 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:27.423029 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:27.439538 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for project cdf9c8d3eace468d852b873213f392f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:59:27.443459 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.quota [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Getting quotas for user 74a5ed7c176f44849677acf29c330e97 and project cdf9c8d3eace468d852b873213f392f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:59:27.499299 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Going to run 1 instances... {{(pid=124658) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:59:27.501387 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61f4a220-a88f-4484-93db-5df3420934a7',volume_size=None,volume_type=None)] {{(pid=124658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:59:27.843390 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaa3f877-e5a9-4ca8-b804-d43c3f324787] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57604. Aug 08 02:59:27.906083 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-47330cdd-3be1-4e33-a1cf-401c6894e699 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.084643 Aug 08 02:59:27.906753 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 634/1275] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 02:59:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:59:27.915794 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b84842f-1ecb-4037-be75-a807c48882c9] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 02:59:27.916400 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:27.917491 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=76 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:27.922201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-12dd165a-c087-4b30-b3bd-e6f9db27511b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:27.923345 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-12dd165a-c087-4b30-b3bd-e6f9db27511b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:28.030177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-12dd165a-c087-4b30-b3bd-e6f9db27511b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:28.037983 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-12dd165a-c087-4b30-b3bd-e6f9db27511b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1094 microversion: 2.1 time: 0.124092 Aug 08 02:59:28.038607 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 642/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:27 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1094 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:29.059251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:29.059864 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:29.065933 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:29.066442 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:29.066876 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:29.067565 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:29.068021 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:29.068448 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:29.130008 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:29.140853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ab9e0d48-57e3-4e5e-9567-5d904c71744a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1136 microversion: 2.1 time: 0.086080 Aug 08 02:59:29.141477 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 635/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:29 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:30.162911 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:30.163697 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:30.172638 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:30.173142 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:30.173587 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:30.174306 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:30.174799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:30.175485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:30.181620 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b84842f-1ecb-4037-be75-a807c48882c9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57628. Aug 08 02:59:30.249685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:30.257302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-84e2dcc3-3585-424b-b9c5-c83c9ba9c2bf tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1210 microversion: 2.1 time: 0.098312 Aug 08 02:59:30.257870 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 643/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:30 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:31.212058 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-61e75d8a-7226-419b-be1d-deeaf5e56129 req-d8189801-4287-4a7d-8c2c-b60a5af7089e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9f5d9e-302f-4f21-b891-9e45967c8120", "tag": "1aa172e4-e033-4cc3-8b29-d663cb2b53a7"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:59:31.224951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-61e75d8a-7226-419b-be1d-deeaf5e56129 req-d8189801-4287-4a7d-8c2c-b60a5af7089e service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:31.224951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-61e75d8a-7226-419b-be1d-deeaf5e56129 req-d8189801-4287-4a7d-8c2c-b60a5af7089e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:31.224951 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-61e75d8a-7226-419b-be1d-deeaf5e56129 req-d8189801-4287-4a7d-8c2c-b60a5af7089e service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:31.235433 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-61e75d8a-7226-419b-be1d-deeaf5e56129 req-d8189801-4287-4a7d-8c2c-b60a5af7089e service nova] Creating event network-changed:1aa172e4-e033-4cc3-8b29-d663cb2b53a7 for instance bb9f5d9e-302f-4f21-b891-9e45967c8120 on hv-cinder-85226 Aug 08 02:59:31.240779 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-61e75d8a-7226-419b-be1d-deeaf5e56129 req-d8189801-4287-4a7d-8c2c-b60a5af7089e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032776 Aug 08 02:59:31.242322 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 636/1279] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:59:31.279551 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:31.280160 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:31.286837 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:31.287309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:31.287739 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:31.288429 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:31.288909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:31.289334 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:31.423302 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:31.431210 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f791cb2d-79a9-4c4b-83e7-de0096437009 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.156232 Aug 08 02:59:31.431780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 644/1280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:31 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:32.453688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:32.454408 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:32.460688 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:32.461148 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:32.461584 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:32.462269 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:32.462755 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:32.463183 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:32.594709 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:32.602032 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-a61ac35f-0ce1-4cad-96bd-db9bff1c0add tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.153317 Aug 08 02:59:32.602623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 637/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:32 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:59:33.623187 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:33.623799 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:33.630182 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:33.630685 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:33.631121 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:33.631813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:33.632291 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:33.633309 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:33.764337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:33.771785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-af91b72d-7a58-4b0e-84d9-d2e333764fa8 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.153176 Aug 08 02:59:33.772346 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 645/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:33 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:34.792294 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:34.792915 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:34.799251 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:34.799736 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:34.800425 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:34.801123 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:34.801580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:34.802010 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:34.932447 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:34.940577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-58b09969-436c-453d-8589-62e1c190099a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.152132 Aug 08 02:59:34.941138 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 638/1283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:34 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:35.960516 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:35.961130 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:35.967618 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:35.968086 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:35.968519 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:35.969206 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:35.969658 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:35.970092 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:36.110803 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:36.118475 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8bdf298f-ac72-44b2-98e3-6a6984f05ea5 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.161773 Aug 08 02:59:36.119037 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 646/1284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:35 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:37.139957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:37.140580 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:37.146969 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:37.147449 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:37.147880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:37.148567 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:37.149019 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:37.149443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:37.282722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:37.290435 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-430ba5e6-ed42-456d-8fa6-995ce123737e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.154865 Aug 08 02:59:37.291361 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 639/1285] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:37 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:59:38.311821 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:38.312458 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:38.315061 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:38.319807 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:38.324939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:38.324939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:38.324939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:38.324939 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:38.325349 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:38.450881 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:38.458189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5322c65c-91e2-4b44-b829-698198fc9c5d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.150193 Aug 08 02:59:38.458780 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 647/1286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:38 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:39.478309 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:39.478948 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:39.480968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=2 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:39.481611 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell0:SELECT=6 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:59:39.486842 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:39.487316 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:39.487757 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:39.488422 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:39.488871 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:39.489292 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:39.621713 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:39.629244 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-094813ee-3e51-4c02-b263-2a2c0f209942 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.154725 Aug 08 02:59:39.631146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 640/1287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:39 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:40.650690 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:40.651296 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:40.658909 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:40.659383 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:40.659813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:40.660500 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:40.660946 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:40.661365 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:40.789577 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:40.798201 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d5dcc46a-5ef8-4869-9eac-41b88c75465a tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.151349 Aug 08 02:59:40.798785 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 648/1288] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:40 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:41.468137 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-5e201c89-9f78-4acd-b4ab-a7d55d33736e req-9adc2d63-599c-4fee-8086-4544aff0ea5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9f5d9e-302f-4f21-b891-9e45967c8120", "name": "network-vif-plugged", "status": "completed", "tag": "1aa172e4-e033-4cc3-8b29-d663cb2b53a7"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:59:41.478079 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5e201c89-9f78-4acd-b4ab-a7d55d33736e req-9adc2d63-599c-4fee-8086-4544aff0ea5f service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:41.478606 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5e201c89-9f78-4acd-b4ab-a7d55d33736e req-9adc2d63-599c-4fee-8086-4544aff0ea5f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:41.479054 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-5e201c89-9f78-4acd-b4ab-a7d55d33736e req-9adc2d63-599c-4fee-8086-4544aff0ea5f service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:41.489722 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-5e201c89-9f78-4acd-b4ab-a7d55d33736e req-9adc2d63-599c-4fee-8086-4544aff0ea5f service nova] Creating event network-vif-plugged:1aa172e4-e033-4cc3-8b29-d663cb2b53a7 for instance bb9f5d9e-302f-4f21-b891-9e45967c8120 on hv-cinder-85226 Aug 08 02:59:41.494780 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-5e201c89-9f78-4acd-b4ab-a7d55d33736e req-9adc2d63-599c-4fee-8086-4544aff0ea5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030729 Aug 08 02:59:41.495457 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 641/1289] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:59:41.819292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:41.819902 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:41.826558 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:41.829208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:41.829208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:41.829208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:41.829208 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:41.829644 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:41.970712 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:41.978189 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8c21253a-7191-41c5-9cdc-f1dd827d5dd7 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.162779 Aug 08 02:59:41.978788 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 649/1290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:41 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:43.000701 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:43.001393 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:43.007602 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:43.008084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:43.008519 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:43.009207 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:43.009658 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:43.010085 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:43.143623 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:43.151089 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-9385992d-c2b9-4fe6-86fc-fa5f90806f5e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1266 microversion: 2.1 time: 0.155695 Aug 08 02:59:43.151661 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 642/1291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:42 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:44.172394 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:44.173009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:44.179736 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:44.180163 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:44.180602 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:44.181295 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:44.181755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:44.182184 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:44.310986 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:44.318453 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8589c5f7-c84c-488d-b628-0ebb57542b3b tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1454 microversion: 2.1 time: 0.150730 Aug 08 02:59:44.319020 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 650/1292] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:44 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:44.338092 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:59:44.338754 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:59:44.345591 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:44.346067 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:44.346530 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:44.347213 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:44.347660 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:44.348084 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:44.479582 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:59:44.487930 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-964df154-545a-4baa-ad73-62f98bda6f6e tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1454 microversion: 2.1 time: 0.153625 Aug 08 02:59:44.488497 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 643/1293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 02:59:44 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:59:46.623073 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-979b1ac7-356b-43d5-8ba2-6d2add03af4b req-7a2bc91a-fdf2-47b1-909c-ea35143cddeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9f5d9e-302f-4f21-b891-9e45967c8120", "tag": "1aa172e4-e033-4cc3-8b29-d663cb2b53a7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:59:46.632629 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-979b1ac7-356b-43d5-8ba2-6d2add03af4b req-7a2bc91a-fdf2-47b1-909c-ea35143cddeb service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:59:46.633098 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-979b1ac7-356b-43d5-8ba2-6d2add03af4b req-7a2bc91a-fdf2-47b1-909c-ea35143cddeb service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:59:46.633524 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-979b1ac7-356b-43d5-8ba2-6d2add03af4b req-7a2bc91a-fdf2-47b1-909c-ea35143cddeb service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:59:46.645305 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-979b1ac7-356b-43d5-8ba2-6d2add03af4b req-7a2bc91a-fdf2-47b1-909c-ea35143cddeb service nova] Creating event network-changed:1aa172e4-e033-4cc3-8b29-d663cb2b53a7 for instance bb9f5d9e-302f-4f21-b891-9e45967c8120 on hv-cinder-85226 Aug 08 02:59:46.650337 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-979b1ac7-356b-43d5-8ba2-6d2add03af4b req-7a2bc91a-fdf2-47b1-909c-ea35143cddeb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031425 Aug 08 02:59:46.651024 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 651/1294] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 02:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 03:00:21.469107 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:00:21.469952 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 03:00:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:00:42.089912 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:00:42.090525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 03:00:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:01:37.556639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 03:01:37.556639 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG dbcounter [-] [124658] Writing DB stats nova_cell1:SELECT=48 {{(pid=124658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 03:01:37.557613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b84842f-1ecb-4037-be75-a807c48882c9] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 03:01:37.557613 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=22 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 03:01:37.558174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=50 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 03:01:37.560177 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:37.560741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:37.567741 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:37.568243 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:37.568928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:37.569853 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:37.570335 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:37.577045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:37.603455 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 03:01:37.623710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-3b173bc8-e868-496b-b7e7-35beeeee6ed5 req-01fe387f-332e-4757-8981-8120326c8e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9f5d9e-302f-4f21-b891-9e45967c8120", "tag": "1aa172e4-e033-4cc3-8b29-d663cb2b53a7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 03:01:37.635248 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3b173bc8-e868-496b-b7e7-35beeeee6ed5 req-01fe387f-332e-4757-8981-8120326c8e07 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:37.636026 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3b173bc8-e868-496b-b7e7-35beeeee6ed5 req-01fe387f-332e-4757-8981-8120326c8e07 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:37.636967 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3b173bc8-e868-496b-b7e7-35beeeee6ed5 req-01fe387f-332e-4757-8981-8120326c8e07 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:37.651488 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-3b173bc8-e868-496b-b7e7-35beeeee6ed5 req-01fe387f-332e-4757-8981-8120326c8e07 service nova] Creating event network-changed:1aa172e4-e033-4cc3-8b29-d663cb2b53a7 for instance bb9f5d9e-302f-4f21-b891-9e45967c8120 on hv-cinder-85226 Aug 08 03:01:37.656593 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-3b173bc8-e868-496b-b7e7-35beeeee6ed5 req-01fe387f-332e-4757-8981-8120326c8e07 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102226 Aug 08 03:01:37.657177 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 652/1295] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 03:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 03:01:37.849593 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-94dc20ed-78d3-40fa-82e7-38841094d270 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 204 len: 0 microversion: 2.1 time: 0.297699 Aug 08 03:01:37.850176 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 644/1296] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 03:01:37 2022] DELETE /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 03:01:37.859027 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:37.859783 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:37.866010 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:37.866539 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:37.867034 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:37.867731 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:37.868178 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:37.868598 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:38.013806 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 03:01:38.028145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4fefe978-28d7-48fd-a4e2-d5ae96344ac9 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1578 microversion: 2.1 time: 0.167838 Aug 08 03:01:38.028145 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 653/1297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:37 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 03:01:39.044490 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:39.045232 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:39.052036 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:39.052516 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:39.052957 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:39.053656 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:39.054106 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:39.054557 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:39.188525 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 03:01:39.196621 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-b0d45667-0a5c-4eb7-a8fd-4fb8f62159d2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1578 microversion: 2.1 time: 0.156361 Aug 08 03:01:39.197185 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 645/1298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:39 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 03:01:40.038470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-431a2e45-60fd-4e36-8e13-31f78bab0ff5 req-4ab46a9d-8d4d-4f35-9bfa-77d513c92574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9f5d9e-302f-4f21-b891-9e45967c8120", "name": "network-vif-deleted", "tag": "1aa172e4-e033-4cc3-8b29-d663cb2b53a7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 03:01:40.048913 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-431a2e45-60fd-4e36-8e13-31f78bab0ff5 req-4ab46a9d-8d4d-4f35-9bfa-77d513c92574 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:40.050174 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-431a2e45-60fd-4e36-8e13-31f78bab0ff5 req-4ab46a9d-8d4d-4f35-9bfa-77d513c92574 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:40.050585 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-431a2e45-60fd-4e36-8e13-31f78bab0ff5 req-4ab46a9d-8d4d-4f35-9bfa-77d513c92574 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:40.062171 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-431a2e45-60fd-4e36-8e13-31f78bab0ff5 req-4ab46a9d-8d4d-4f35-9bfa-77d513c92574 service nova] Creating event network-vif-deleted:1aa172e4-e033-4cc3-8b29-d663cb2b53a7 for instance bb9f5d9e-302f-4f21-b891-9e45967c8120 on hv-cinder-85226 Aug 08 03:01:40.067710 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-431a2e45-60fd-4e36-8e13-31f78bab0ff5 req-4ab46a9d-8d4d-4f35-9bfa-77d513c92574 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Aug 08 03:01:40.068292 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 654/1299] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 03:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 03:01:40.218673 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:40.219289 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:40.226444 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:40.226851 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:40.227290 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:40.227985 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:40.228443 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:40.228870 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:40.290781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 03:01:40.298919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-58e39ab3-542c-41d9-a69a-26f5e2a864ba tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 200 len: 1225 microversion: 2.1 time: 0.084136 Aug 08 03:01:40.299612 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 646/1300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:40 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 03:01:41.319997 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:41.320714 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: bb9f5d9e-302f-4f21-b891-9e45967c8120] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:41.322813 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b84842f-1ecb-4037-be75-a807c48882c9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57718. Aug 08 03:01:41.327671 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:41.328144 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:41.328575 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:41.329256 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:41.329706 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:41.330131 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:41.343118 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] HTTP exception thrown: Instance bb9f5d9e-302f-4f21-b891-9e45967c8120 could not be found. Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Request method failure captured: Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 HTTP/1.1 Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8Hq9FW1mAVnZyod4VTpBxr8WggqmaxJp94RGCmHwOT9_vfi7Vvrz-SCvqab75hunBvBrkVR28vYEbcQTBry6z6zqGsRQRWOrQurXejsA3Sol5S976YchoZqiiq-czDRgtXrX4ZviBKyfaxJyUbNBE8ZkOFBjlwYYMw7sycVsgFpbWmw Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 03:01:41.344737 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 74a5ed7c176f44849677acf29c330e97 Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance bb9f5d9e-302f-4f21-b891-9e45967c8120 could not be found. Aug 08 03:01:41.347707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bb9f5d9e-302f-4f21-b891-9e45967c8120'} Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9f5d9e-302f-4f21-b891-9e45967c8120 could not be found. Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 03:01:41.348755 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9f5d9e-302f-4f21-b891-9e45967c8120 could not be found. Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9f5d9e-302f-4f21-b891-9e45967c8120 could not be found. Aug 08 03:01:41.350762 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:41.352319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Returning 404 to user: Instance bb9f5d9e-302f-4f21-b891-9e45967c8120 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 03:01:41.352319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f14598b8-8879-41ef-8d46-b6698217bb00 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120" status: 404 len: 111 microversion: 2.1 time: 0.030341 Aug 08 03:01:41.352319 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 655/1301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:41 2022] GET /compute/v2.1/servers/bb9f5d9e-302f-4f21-b891-9e45967c8120 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 03:01:44.887337 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:44.887850 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:44.889179 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-e50db84c-1c97-4052-bc78-fcac9c1c200a req-451a1593-a185-49f3-a686-c960ecb4be04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f4cf43-9cde-4bfb-9c94-b8b4c530938f", "tag": "43f4773b-1fae-41e1-8ce6-050724184dee"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 03:01:44.894649 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:44.895216 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:44.895751 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:44.896517 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:44.897037 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:44.897531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:44.899338 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-e50db84c-1c97-4052-bc78-fcac9c1c200a req-451a1593-a185-49f3-a686-c960ecb4be04 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:44.900083 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-e50db84c-1c97-4052-bc78-fcac9c1c200a req-451a1593-a185-49f3-a686-c960ecb4be04 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:44.900625 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-e50db84c-1c97-4052-bc78-fcac9c1c200a req-451a1593-a185-49f3-a686-c960ecb4be04 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:44.911907 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-e50db84c-1c97-4052-bc78-fcac9c1c200a req-451a1593-a185-49f3-a686-c960ecb4be04 service nova] Creating event network-changed:43f4773b-1fae-41e1-8ce6-050724184dee for instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f on hv-cinder-85226 Aug 08 03:01:44.923561 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Going to try to terminate instance {{(pid=124658) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 03:01:44.924823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-e50db84c-1c97-4052-bc78-fcac9c1c200a req-451a1593-a185-49f3-a686-c960ecb4be04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038713 Aug 08 03:01:44.925444 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 656/1302] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 03:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 03:01:45.192634 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-ac49bd4d-f056-405a-8a7f-96f6732cb033 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 204 len: 0 microversion: 2.1 time: 0.309142 Aug 08 03:01:45.193254 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 647/1303] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 03:01:44 2022] DELETE /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 03:01:45.202974 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:45.203681 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:45.210430 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:45.210930 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:45.211418 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:45.212396 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:45.212857 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:45.213285 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:45.355507 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 03:01:45.364023 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bb2ad240-a7d8-4f9b-97cb-179c4d31ccfd tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1577 microversion: 2.1 time: 0.166077 Aug 08 03:01:45.364641 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 657/1304] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:45 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 03:01:46.385494 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:46.386193 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:46.393028 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:46.393632 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:46.394104 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:46.394831 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:46.395284 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:46.395707 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:46.529712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.policy [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124658) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 03:01:46.537781 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-204b8061-56fd-4fbd-93f5-3ecc1b1391f2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1577 microversion: 2.1 time: 0.156535 Aug 08 03:01:46.538342 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 648/1305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:46 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 03:01:47.560018 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:47.560815 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:47.565919 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [req-4ba17d2a-774e-463c-9e23-ec16b6b1a301 req-e92febe7-b1f6-4c8a-b9c2-8a2e51300461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f4cf43-9cde-4bfb-9c94-b8b4c530938f", "name": "network-vif-deleted", "tag": "43f4773b-1fae-41e1-8ce6-050724184dee"}]} {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 03:01:47.568336 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:47.568823 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:47.569320 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:47.570028 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:47.570540 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:47.570972 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:47.576124 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4ba17d2a-774e-463c-9e23-ec16b6b1a301 req-e92febe7-b1f6-4c8a-b9c2-8a2e51300461 service nova] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:47.576609 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4ba17d2a-774e-463c-9e23-ec16b6b1a301 req-e92febe7-b1f6-4c8a-b9c2-8a2e51300461 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:47.581880 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [req-4ba17d2a-774e-463c-9e23-ec16b6b1a301 req-e92febe7-b1f6-4c8a-b9c2-8a2e51300461 service nova] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:47.591730 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.compute.server_external_events [req-4ba17d2a-774e-463c-9e23-ec16b6b1a301 req-e92febe7-b1f6-4c8a-b9c2-8a2e51300461 service nova] Creating event network-vif-deleted:43f4773b-1fae-41e1-8ce6-050724184dee for instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f on hv-cinder-85226 Aug 08 03:01:47.596521 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [req-4ba17d2a-774e-463c-9e23-ec16b6b1a301 req-e92febe7-b1f6-4c8a-b9c2-8a2e51300461 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Aug 08 03:01:47.598329 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 649/1306] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 03:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 03:01:47.636901 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5ed7c176f44849677acf29c330e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf9c8d3eace468d852b873213f392f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 03:01:47.645407 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c398bac8-778a-414e-8635-68f75ef2f5b4 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 200 len: 1391 microversion: 2.1 time: 0.089307 Aug 08 03:01:47.645975 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 658/1307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:47 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 03:01:48.667788 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:48.668481 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 82f4cf43-9cde-4bfb-9c94-b8b4c530938f] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:48.675017 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:48.675493 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:48.675924 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:48.676712 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:48.677198 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:48.677657 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:48.691121 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] HTTP exception thrown: Instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f could not be found. Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Request method failure captured: Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f HTTP/1.1 Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8Hq9FW1mAVnZyod4VTpBxr8WggqmaxJp94RGCmHwOT9_vfi7Vvrz-SCvqab75hunBvBrkVR28vYEbcQTBry6z6zqGsRQRWOrQurXejsA3Sol5S976YchoZqiiq-czDRgtXrX4ZviBKyfaxJyUbNBE8ZkOFBjlwYYMw7sycVsgFpbWmw Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 03:01:48.692690 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 74a5ed7c176f44849677acf29c330e97 Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f could not be found. Aug 08 03:01:48.694426 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '82f4cf43-9cde-4bfb-9c94-b8b4c530938f'} Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f could not be found. Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 03:01:48.695554 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f could not be found. Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f could not be found. Aug 08 03:01:48.697295 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:48.698928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Returning 404 to user: Instance 82f4cf43-9cde-4bfb-9c94-b8b4c530938f could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 03:01:48.698928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-f2475966-34b9-4711-9880-e51ba84ff32d tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f" status: 404 len: 111 microversion: 2.1 time: 0.031384 Aug 08 03:01:48.698928 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 650/1308] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:48 2022] GET /compute/v2.1/servers/82f4cf43-9cde-4bfb-9c94-b8b4c530938f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 03:01:49.215772 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:49.216303 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:49.223639 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:49.224121 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:49.224560 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:49.225253 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:49.225707 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:49.226133 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:49.242115 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] HTTP exception thrown: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Request method failure captured: Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 HTTP/1.1 Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept: application/json Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Connection: close Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Length: 0 Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Content-Type: application/json Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Host: 10.222.0.15 Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.11 Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABi8Hq9FW1mAVnZyod4VTpBxr8WggqmaxJp94RGCmHwOT9_vfi7Vvrz-SCvqab75hunBvBrkVR28vYEbcQTBry6z6zqGsRQRWOrQurXejsA3Sol5S976YchoZqiiq-czDRgtXrX4ZviBKyfaxJyUbNBE8ZkOFBjlwYYMw7sycVsgFpbWmw Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Role: member,reader Aug 08 03:01:49.243796 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Roles: member,reader Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Id: 74a5ed7c176f44849677acf29c330e97 Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: method: > Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: exception: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.245599 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: action_args: {'id': '2db7557f-f807-42e7-8b82-65907d38a8f8'} Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 03:01:49.246827 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.248485 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.250288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Returning 404 to user: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 03:01:49.250288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fac76e9d-48b8-4f07-959d-0eac0bb6dee3 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 404 len: 111 microversion: 2.1 time: 0.033263 Aug 08 03:01:49.250288 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 659/1309] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 03:01:49 2022] DELETE /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 03:01:49.254239 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '>' {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:49.254991 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.compute.api [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] [instance: 2db7557f-f807-42e7-8b82-65907d38a8f8] Fetching instance by UUID {{(pid=124658) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 03:01:49.261045 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:49.261531 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:49.261968 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:49.262686 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Acquiring lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 03:01:49.263146 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 03:01:49.263577 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG oslo_concurrency.lockutils [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Lock "5baaec13-31d8-4da8-83a2-55eae616e5e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 03:01:49.277931 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.wsgi [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] HTTP exception thrown: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Request method failure captured: Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: request: GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 HTTP/1.1 Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept: application/json Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Accept-Encoding: identity Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Connection: close Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Length: 0 Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Content-Type: application/json Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Host: 10.222.0.15 Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Openstack-System-Scope: None Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: User-Agent: python-urllib3/1.26.11 Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Auth-Token: gAAAAABi8Hq9FW1mAVnZyod4VTpBxr8WggqmaxJp94RGCmHwOT9_vfi7Vvrz-SCvqab75hunBvBrkVR28vYEbcQTBry6z6zqGsRQRWOrQurXejsA3Sol5S976YchoZqiiq-czDRgtXrX4ZviBKyfaxJyUbNBE8ZkOFBjlwYYMw7sycVsgFpbWmw Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Id: None Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Domain-Name: None Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Identity-Status: Confirmed Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Is-Admin-Project: True Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Id: default Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Domain-Name: Default Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Project-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Role: member,reader Aug 08 03:01:49.279507 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Roles: member,reader Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cdf9c8d3eace468d852b873213f392f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Id: cdf9c8d3eace468d852b873213f392f4 Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-Tenant-Name: tempest-TestVolumeBootPattern-946919866 Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Id: default Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Domain-Name: Default Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Id: 74a5ed7c176f44849677acf29c330e97 Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: X-User-Name: tempest-TestVolumeBootPattern-946919866-project Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: method: > Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: exception: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.281271 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: action_args: {'id': '2db7557f-f807-42e7-8b82-65907d38a8f8'} Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: {{(pid=124658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 03:01:49.282401 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. Aug 08 03:01:49.285063 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: ERROR nova.api.openstack.wsgi Aug 08 03:01:49.286695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: DEBUG nova.api.openstack.wsgi [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Returning 404 to user: Instance 2db7557f-f807-42e7-8b82-65907d38a8f8 could not be found. {{(pid=124658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 03:01:49.286695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO nova.api.openstack.requestlog [None req-3e4bb841-fd56-4826-a6f9-4fe302b36e06 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8" status: 404 len: 111 microversion: 2.1 time: 0.030897 Aug 08 03:01:49.286695 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: [pid: 124658|app: 0|req: 651/1310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 03:01:49 2022] GET /compute/v2.1/servers/2db7557f-f807-42e7-8b82-65907d38a8f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 03:01:50.768194 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d5d4ffa6-d9c2-405c-8456-50ef3ef918b2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] Calling method '.version_select at 0x7fb2be9b6670>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 03:01:50.856581 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d5d4ffa6-d9c2-405c-8456-50ef3ef918b2 tempest-TestVolumeBootPattern-946919866 tempest-TestVolumeBootPattern-946919866-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710688674" status: 202 len: 0 microversion: 2.1 time: 0.092618 Aug 08 03:01:50.857205 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 660/1311] 10.222.0.15 () {58 vars in 1260 bytes} [Mon Aug 8 03:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710688674 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 03:02:27.457470 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:02:27.458156 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 03:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:02:28.001262 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:02:28.001746 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 03:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:04:02.098332 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:04:02.099024 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 03:04:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:04:19.785893 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:04:19.786514 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 03:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:05:47.466417 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:05:47.467009 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 03:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:05:48.009389 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:05:48.009895 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 03:05:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:07:01.482203 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:07:01.482842 dv-cinder-852261-2-iscsi devstack@n-api.service[124659]: Mon Aug 8 03:07:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 03:07:22.107383 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 03:07:22.108026 dv-cinder-852261-2-iscsi devstack@n-api.service[124658]: Mon Aug 8 03:07:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!